-- Logs begin at Fri 2022-08-26 10:26:48 UTC, end at Fri 2022-08-26 11:25:08 UTC. -- Aug 26 10:56:15.666799 dv-cinder-852369-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 26 10:56:15.675611 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 26 10:56:15.677583 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 10:56:15 2022] *** Aug 26 10:56:15.677583 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 10:56:15.677583 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 10:56:15.677583 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: nodename: dv-cinder-852369-2-iscsi Aug 26 10:56:15.677583 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: machine: x86_64 Aug 26 10:56:15.677583 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: clock source: unix Aug 26 10:56:15.677583 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: pcre jit disabled Aug 26 10:56:15.677583 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: detected number of CPU cores: 4 Aug 26 10:56:15.677583 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: current working directory: / Aug 26 10:56:15.677583 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: detected binary path: /usr/bin/uwsgi-core Aug 26 10:56:15.677583 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: your processes number limit is 47680 Aug 26 10:56:15.678411 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: your memory page size is 4096 bytes Aug 26 10:56:15.678411 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: detected max file descriptor number: 2048 Aug 26 10:56:15.678411 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: lock engine: pthread robust mutexes Aug 26 10:56:15.678411 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: thunder lock: enabled Aug 26 10:56:15.678411 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 26 10:56:15.678411 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 10:56:15.717421 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: Python main interpreter initialized at 0x55bc972049c0 Aug 26 10:56:15.717421 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: python threads support enabled Aug 26 10:56:15.717421 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: your server socket listen backlog is limited to 100 connections Aug 26 10:56:15.717421 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: your mercy for graceful operations on workers is 90 seconds Aug 26 10:56:15.717762 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 10:56:15.717839 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: *** Operational MODE: preforking *** Aug 26 10:56:15.718088 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: *** uWSGI is running in multiple interpreter mode *** Aug 26 10:56:15.718088 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: spawned uWSGI master process (pid: 105593) Aug 26 10:56:15.718269 dv-cinder-852369-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 26 10:56:15.718816 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: spawned uWSGI worker 1 (pid: 105594, cores: 1) Aug 26 10:56:15.719163 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: spawned uWSGI worker 2 (pid: 105595, cores: 1) Aug 26 10:56:15.719320 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 10:56:16.379367 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 10:56:16.379988 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 10:56:17.460481 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 10:56:17.460481 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: from cryptography.utils import int_from_bytes Aug 26 10:56:17.461158 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 10:56:17.461158 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: from cryptography.utils import int_from_bytes Aug 26 10:56:17.462573 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 10:56:17.462573 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: from cryptography.utils import int_from_bytes Aug 26 10:56:17.462993 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 10:56:17.462993 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: from cryptography.utils import int_from_bytes Aug 26 10:56:19.940900 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 10:56:19.941401 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 10:56:19.941656 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 10:56:19.942031 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 10:56:19.942284 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 10:56:19.942660 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.942976 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.943282 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 10:56:19.943641 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.943734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 10:56:19.943815 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.943893 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.944054 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 10:56:19.944184 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.944422 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 10:56:19.944510 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.944685 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 10:56:19.944799 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.945075 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.945159 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.945358 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.945444 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.945664 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.945758 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.945998 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852369-2-iscsi {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.946087 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.946315 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.946409 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.946615 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.946700 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.946918 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.947072 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.947229 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.947364 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.947527 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.947661 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.947842 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.947979 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.948140 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.948266 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.948489 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852369-2-iscsi {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.948615 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.948816 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.950525 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.950690 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.950808 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.950939 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.951063 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.951202 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.951327 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.951457 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.951589 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.951719 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.951852 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.951966 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.952087 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.952087 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.952325 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.952461 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.952593 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.952727 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.952840 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.952961 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852369-2-iscsi {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.953098 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.953242 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.953376 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.953499 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.953610 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.953739 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.953863 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.954014 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.954134 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.954255 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.954377 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.954514 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.954638 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.954892 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.955030 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.955155 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.955374 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852369-2-iscsi {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.955510 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.955634 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.955765 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.955898 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.956021 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.956187 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.956330 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.956587 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.956721 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.956882 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.957002 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.957184 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.957319 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.957485 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.957613 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.957795 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.957921 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.958116 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.958261 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.958416 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.958544 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.958673 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.958802 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.958948 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.959073 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.959262 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.959391 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.959575 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.959702 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.959886 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.960027 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.960158 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.960280 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.960404 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.960549 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.960684 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.960857 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.960984 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.961164 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.961298 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.961423 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.961560 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.961715 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.961842 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.962066 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.962195 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.962392 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.962537 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.962689 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.962816 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.962941 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.963063 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.963184 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.963316 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.963498 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.963626 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.963823 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.963950 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.964134 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.964263 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.964440 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.964567 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.964745 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.964894 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.965146 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.965277 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.965400 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.965558 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.966250 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.966375 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.966516 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.966641 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.966802 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.966930 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.967123 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.967252 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.967442 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.967570 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.967767 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.967903 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.968078 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.968215 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.968382 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.968507 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.968681 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.968827 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.968991 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.969132 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.969315 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.969450 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.969614 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.969741 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.969866 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.970045 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.970172 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.970294 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.970454 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.970593 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.970766 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.970909 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.971064 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.971191 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.971362 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.971503 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.971661 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.971797 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.971952 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.972092 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.972251 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.972406 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.972546 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.972714 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.972854 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.972982 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.973113 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.973259 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.973398 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.973567 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.973702 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.973887 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.974037 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.974222 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.974383 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.974531 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.974668 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.974840 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.974968 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.975240 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.975370 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.975493 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.975614 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.975725 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.975846 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.976003 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.976133 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.976300 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.976428 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.976614 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.976751 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.976912 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.977048 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.977209 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.977337 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.977514 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.977639 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.977810 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.977944 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.978115 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.978239 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.978429 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.978566 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.978730 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.978865 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.979029 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.979156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.979338 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.979477 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.979619 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.979817 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.979944 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.980073 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.980197 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.980320 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.980496 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.980624 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.980793 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.980920 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.981089 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.981334 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.981477 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.981601 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.981745 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.981879 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.982070 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.982212 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.982371 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.982507 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.982667 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.982803 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.982961 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.983098 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.983273 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.983408 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.983584 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.983714 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.983886 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.984021 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.984186 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.984314 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.984485 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.984620 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.984788 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.984924 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.985097 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.985357 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.985486 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.985610 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.985742 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.985874 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.986032 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.986158 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.986302 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.986430 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.986876 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.987006 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.987202 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.987328 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.987516 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.987643 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.987826 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.987953 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.988133 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.988259 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.988436 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.988561 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 10:56:19.988743 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.988878 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.989048 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.989175 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.989360 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.989496 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.989672 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.989800 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.990006 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.990136 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.990322 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.990459 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.990636 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.990771 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.990948 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.991075 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.991255 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.991391 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.991567 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.991704 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.991888 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.992026 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.992202 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.992343 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.992508 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.992636 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.992828 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.992964 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.993152 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.993291 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.993462 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.993590 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.993778 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.993905 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.994115 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.994254 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.994422 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.994551 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.994727 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.994859 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.995031 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.995160 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.995420 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.995552 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.995675 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.995806 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.995944 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.996078 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.996256 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.996385 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.996563 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.996693 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.996903 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.997031 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.997212 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.997414 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.997542 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.997742 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.997883 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.998095 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.998236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.998368 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.998500 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.998684 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.998821 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.999012 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.999140 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.999331 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.999458 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.999643 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.999771 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:19.999949 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.000076 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.000260 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.000380 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.000566 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.000696 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.000869 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.000997 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.001173 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.001302 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.001472 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.001607 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.001770 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.001897 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.002101 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.002229 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.002435 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.002563 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.002693 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.002818 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.002989 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.003125 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.003308 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.003445 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.003609 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.003729 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.003933 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.004069 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.004231 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.004367 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.004536 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.004663 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.004839 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.004976 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.005147 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.005283 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.005546 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.005679 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.005814 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.005948 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.006127 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.006250 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.006373 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.006497 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.006636 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.006769 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.006921 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.007061 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.007222 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.007349 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.007536 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.007674 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.007836 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.007973 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.008136 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.008264 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.008443 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.008571 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.008748 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.008875 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.009052 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.009179 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.009356 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.009492 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.009662 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.009791 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.009986 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.010126 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.010310 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.010436 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.010616 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.010744 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.010922 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.011056 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.011250 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.011377 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.011543 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.011668 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.011854 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.011989 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.012170 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.012298 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.013085 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.013220 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.013533 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.013670 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.013845 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.014006 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.014173 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.014301 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.014475 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.014604 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.014774 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.014911 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.015080 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.015207 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.015379 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.015647 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.015780 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.015904 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.016027 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.016149 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.016293 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.016428 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.016553 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.016676 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.016839 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.016993 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.017129 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.017304 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.017432 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.017619 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.017747 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.017930 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.018101 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.018264 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.018392 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.018573 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.018700 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.018886 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.019022 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.019195 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.019323 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.019505 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.019633 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.019812 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.019940 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.020122 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.020249 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.020430 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.020558 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.020734 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.020861 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.021042 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.021229 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.021362 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.021495 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.021641 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.021768 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.021946 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.022106 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.022278 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.022412 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.022592 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.022726 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.022897 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.023025 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.023216 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.023352 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.023520 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.023648 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.023838 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.023965 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.024140 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.024278 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.024452 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.024586 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.024786 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.024912 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.025113 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.025240 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.025424 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.025549 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.025807 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.025934 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.026099 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.026224 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.026348 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.026473 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.026656 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.026784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.026961 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.027090 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.027267 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.027396 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.027572 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.027707 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.027885 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.028686 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.028832 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.029093 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.029220 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.029441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.029585 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.029798 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.029924 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.030214 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.030343 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.030525 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.030655 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.030841 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.030969 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.031143 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.031270 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.031455 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.031584 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.031770 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.032088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.032222 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.032420 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.032553 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.032677 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.032801 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.032984 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.033113 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.033291 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.033427 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.033595 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.033722 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.033901 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.034068 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.034229 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.034365 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.034531 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.034660 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.034836 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.034974 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.035145 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.035272 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.035450 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.035577 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.035862 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.036015 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.036142 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.036265 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.036395 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.036520 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.036642 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.036783 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.036909 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.037033 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.037205 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.037333 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.037512 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.037641 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.037826 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.037963 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.038143 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.038266 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.038460 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.038589 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.038775 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.038903 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.039073 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.039201 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.039371 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.039499 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.039686 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.039817 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.039991 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.040120 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.040300 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.040430 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.040584 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.040712 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.040882 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.041019 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.041207 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.041333 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.041509 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.041635 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.041807 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.041944 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.042148 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.042277 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.042463 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.042590 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.042768 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.042907 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.043073 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.043200 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.043376 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.043504 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.043717 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.043860 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.044037 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.044196 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.044346 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.044650 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.044897 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.045031 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.045156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.045280 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.045404 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.045535 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.045673 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.045828 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.046151 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.046276 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.046400 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.046522 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.046660 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.046785 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.046915 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.047040 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.047163 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.047333 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.047475 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.047637 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.047765 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.047947 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.048075 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.048362 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.048497 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.048676 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.048804 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.048990 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.049117 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.049306 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.049435 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.049620 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.049756 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.049935 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.050086 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.050284 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.050427 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.050598 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.050726 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.050914 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.051041 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.051228 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.051364 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.051537 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.051674 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.051835 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.051962 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.052133 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.052269 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.052439 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.052709 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.052838 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.053023 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.053158 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.053323 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.053453 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.053629 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.053767 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.053929 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.054093 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.054263 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.054391 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.054562 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.054700 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.054861 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.054989 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.055169 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.055307 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.055468 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.055595 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.055772 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.055908 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.056241 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.056372 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.056496 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.056619 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.056740 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.056873 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.057007 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.057132 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.057255 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.057378 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.057501 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.057632 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.057837 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.057967 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.058164 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.058304 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.058494 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.058623 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.058814 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.058945 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.059142 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.059308 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.059467 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.059670 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.059960 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.060094 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.060219 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.060342 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.060474 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.060608 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.060734 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.060926 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.061080 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.061227 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.061353 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.061530 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.061659 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.061826 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.061956 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.062145 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.062271 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.062448 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.062577 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.062752 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.062879 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.063053 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.063190 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.063350 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.063477 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.063651 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.063779 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.063948 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.064084 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.064258 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.064387 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.064562 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.064690 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.064860 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.064998 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.065158 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.065287 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.065462 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.065590 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.065764 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.065901 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.066220 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.066374 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.066500 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.066622 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.066752 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.066876 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.066999 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.067121 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.067269 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.067410 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.067571 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.067699 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.067869 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.067994 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.068173 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.068300 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.068479 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.068614 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.068778 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.068904 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.069097 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.069232 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.069403 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.069530 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.069703 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.069837 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.070023 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.070168 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.070331 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.070466 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.070630 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.070757 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.070930 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.071066 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.071237 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.071371 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.071554 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.071681 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.071861 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.072000 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.072156 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.072282 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.072460 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.072588 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.072761 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.072897 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.073061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.073187 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.073360 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.073494 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.073664 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.073791 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.073960 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.074134 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.074281 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.074407 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.074580 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.074709 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.075381 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.075542 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.075849 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.075976 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.076110 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.076373 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.076513 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.076637 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.076761 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.076898 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.077023 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.077146 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.077268 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.077398 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.077558 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.077695 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.077859 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.078011 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.078242 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.078386 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.078543 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.078681 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.078854 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.078981 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.079162 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.079297 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.079464 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.079598 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.079769 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.079896 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.080072 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.080207 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.080371 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.080508 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.080680 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.080815 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.080984 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.081112 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.081291 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.081426 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.081586 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.081713 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.081884 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.082066 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.082228 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.082358 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.082535 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.082663 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.082842 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.082970 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.083158 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.083287 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.083474 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.083602 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.083790 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.083918 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.084091 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.084219 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.084395 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.084526 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.084701 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.084902 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.085037 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.085161 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.085284 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.085413 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.085588 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.085724 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.085894 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.086040 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.086225 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.086500 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.086634 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.086766 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.086899 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.087023 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.087146 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.087271 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.087394 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.087526 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.087685 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.087813 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.087990 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.088118 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.088289 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.088419 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.088606 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.088741 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.088909 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.089036 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.089205 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.089335 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.089507 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.089643 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.089805 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.089933 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.090133 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.090263 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.090433 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.090603 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.091675 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.091803 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.091942 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.092068 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.092192 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.092315 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.092438 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.092571 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.092697 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.092820 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.092942 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.093065 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.093232 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.093368 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.093543 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.093672 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.093846 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.093998 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.094191 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.094332 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.094499 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.094629 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.094813 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.094941 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.095122 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.095264 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.095436 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.095571 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.095737 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.095864 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.096044 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.096176 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.096369 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.096632 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.096762 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.096885 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.097017 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.097141 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.097272 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.097396 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.097533 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.097665 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.097832 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.097961 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.098175 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.098303 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.098586 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.098715 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.098894 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.099022 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.099197 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.099324 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.099606 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.099742 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.099914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.100042 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.100222 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.100348 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.100533 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.100670 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.100846 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.100981 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.101165 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.101286 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.101467 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.101604 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.101774 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.101908 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.102105 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.102233 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.102425 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.102566 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.102732 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.102859 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.103072 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.103207 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.103332 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.103455 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.103619 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.103778 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.103937 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.104091 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.104254 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.104514 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.104651 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.104832 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.104960 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.105150 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.105286 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.105479 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.105615 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.105810 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.105939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.106202 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.106470 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.106740 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.106884 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.107012 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.107143 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.107270 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.107394 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.107528 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.107663 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.107796 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.107921 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.108070 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.108198 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.108391 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.108520 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.108702 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.108837 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.109022 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.109156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.109329 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.109472 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.109634 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.109763 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.109935 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.110099 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.110264 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.110403 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.110580 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.110716 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.110881 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.111009 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.111199 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.111328 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.111759 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.111892 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.112079 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.112220 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.112396 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.112524 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.112696 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.112823 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.113073 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.113213 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.113385 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.113513 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.113683 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.113809 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.114024 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.114183 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.114316 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.114409 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.114642 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.114740 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.114939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.115048 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.115252 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.115339 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.115562 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.115651 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.115880 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.115969 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.116187 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.116274 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.116512 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.116601 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.116830 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.116931 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.117139 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.117226 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.117451 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.117539 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.117764 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.117862 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.118084 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.118175 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.118383 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.118472 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.118689 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.118780 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.118989 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.119078 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.119286 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.119383 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.119583 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.119671 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.119886 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.119988 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.120183 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.120281 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.120481 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.120577 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.120779 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.120913 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.121096 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.121198 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.121393 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.121497 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.121707 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.121837 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.122156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.122271 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.122473 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.122569 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.122773 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.122862 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.123073 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.123163 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.123409 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.123498 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.123709 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.123797 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.124031 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.124122 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.124337 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.124432 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.124641 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.124727 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.124998 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.125094 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.125257 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.125344 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.125563 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.125649 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.125868 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.125956 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.126206 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.126304 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.126514 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.126612 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.126823 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.126908 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.127126 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.127231 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.127435 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.127531 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.127740 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.127826 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.128045 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.128141 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.128391 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.128549 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.128701 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.128871 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.129033 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.129179 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.129346 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.129488 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.129673 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.129794 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.130017 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.130110 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.130334 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.130430 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.130655 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.130752 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.130976 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.131079 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.131296 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.131386 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.131599 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.131694 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.131920 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.132006 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.132235 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.132336 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.132548 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.132643 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.132867 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.132965 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.133175 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.133261 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.133481 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.133699 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.133786 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.134062 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.134165 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.134386 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.134474 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.134702 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.134790 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.135017 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.135113 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.135326 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.135414 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.135637 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.135733 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.135947 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.136036 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.136257 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.136344 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.136565 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.136667 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.136872 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.136973 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.137180 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.137268 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.138034 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.138211 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.138332 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.138421 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.138641 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.138767 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.138948 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.139090 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.139268 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.139410 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.139594 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.139729 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.139908 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.140046 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.140217 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.140408 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.140550 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.140730 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.140830 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.141042 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.141318 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.141406 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.141629 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.141788 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.141955 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.142119 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.142299 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.142401 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.142616 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.142726 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.142925 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.143026 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.143237 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.143338 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.143549 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.143641 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.143851 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.143943 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.144152 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.144244 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.144457 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.144559 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.144762 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.144855 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.145061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.145153 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.145377 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.145470 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.145682 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.145774 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.145996 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.146151 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.146307 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.146447 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.146614 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.146854 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.147151 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.147325 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.147465 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.147602 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.147769 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.147915 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.148090 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.148244 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.148410 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.148556 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.148703 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.148841 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.149010 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.149166 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.149328 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.149480 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.149618 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.149763 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.149900 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.150081 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.150255 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.150400 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.150545 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.150692 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.150838 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.150974 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.151136 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.151282 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.151442 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.151588 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.151758 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.151902 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.152040 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.152177 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.152314 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.152592 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.152756 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.152916 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.153103 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.153793 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.153938 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.154147 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.154305 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.154480 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.154626 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.154801 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.154953 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.155166 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.155307 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.155464 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.155602 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.155747 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.155883 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.156040 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.156191 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.156337 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.156476 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.156612 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.156748 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.156893 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.157031 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.157319 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.157474 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.157474 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.157745 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.157893 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.158066 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.158217 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.158359 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.158496 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.158649 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.158789 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.158933 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.159078 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.159237 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.159375 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.159520 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.159666 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.159804 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.159940 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.160084 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.160222 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.160377 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.160516 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.160661 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.160798 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.160935 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.161082 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.161228 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.161366 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.161536 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.161683 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.161958 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.162145 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.162285 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.162423 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.162584 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.162729 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.162899 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.163053 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.163205 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.163344 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.163488 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.163626 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.163839 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.163998 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.164166 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.164313 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.164475 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.164620 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.164765 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.164912 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.165083 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.165236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.165375 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.165518 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.165664 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.165802 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.165970 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.166137 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.166301 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.166448 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.166597 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.166743 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.166906 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.167063 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.167199 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.167503 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.167662 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.167801 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.167938 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.168075 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.168213 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.168365 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.168516 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.168730 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.168878 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.169133 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.169279 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.169448 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.169602 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.169740 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.169877 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.170100 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.170259 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.170410 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.170550 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.170717 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.170869 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.171030 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.171194 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.171333 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.171469 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.171605 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.171740 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.171910 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.172064 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.172225 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.172378 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.172540 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.172684 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.172830 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.172985 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.173133 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.173273 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.173448 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.173593 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.173761 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.173907 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.174097 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.174244 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.174412 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.174556 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.174731 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.174877 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.175047 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.175193 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.175363 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.175509 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.175654 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.175801 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.175966 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.176126 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.176265 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.176402 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.176585 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.176732 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.176886 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.177023 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.177197 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.177355 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.177639 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.177789 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.177934 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.178102 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.178102 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.178273 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.178410 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.178503 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.178713 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.178804 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.179028 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.179176 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.179334 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.179494 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.179634 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.179818 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.179916 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.180143 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.180231 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.180457 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.180546 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.180782 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.180879 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.181077 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.181173 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.181376 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.181472 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.181678 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.181775 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.181991 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.182108 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.182295 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.182396 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.182591 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.182695 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.182891 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.182990 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.183184 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.183310 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.183479 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.183620 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.183770 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.183930 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.184106 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.184280 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.184483 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.184646 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.184793 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.184946 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.185091 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.185235 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.185388 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.185533 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.185685 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.185832 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.185992 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.186157 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.186303 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.186448 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.186601 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.186745 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.186897 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.187050 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.187194 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.187337 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.187481 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.187738 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.187889 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.188044 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.188190 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.188333 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.188477 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.188631 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.188775 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.188931 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.189078 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.189221 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.189371 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.189516 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.189673 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.189819 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.189962 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.190148 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.190379 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.190540 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.190705 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.190851 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.190995 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.191140 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.191282 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.191426 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.191577 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.191723 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.191866 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.191866 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.192164 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.192327 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.192490 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.192635 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.192788 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.192939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.193083 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.193238 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.193383 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.193534 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.193679 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.193839 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.194004 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.194168 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.194315 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.194468 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.194612 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.194762 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.194907 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.195059 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.195204 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.195349 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.195493 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.195636 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.195788 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.195934 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.196078 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.196232 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.196386 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.196531 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.196688 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.196833 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.196976 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.197129 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.197274 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.197418 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.197574 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.197738 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.197952 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.198276 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.198434 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.198589 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.198735 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.198878 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.199029 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.199173 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.199325 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.199485 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.199631 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.199775 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.200539 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.200695 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.200852 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.201005 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.201159 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.201311 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 10:56:20.201463 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.201463 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.201463 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.201878 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.202112 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.202431 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.202752 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.203072 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.203403 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.203736 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.204050 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.204381 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.204712 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.205063 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.205381 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.205728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.206089 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.206406 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.206722 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.207031 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 10:56:20.207279 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 10:56:20.354953 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO dbcounter [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] Registered counter for database nova_api Aug 26 10:56:20.360887 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO dbcounter [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] Registered counter for database nova_api Aug 26 10:56:20.377273 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG oslo_db.sqlalchemy.engines [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 10:56:20.381157 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_db.sqlalchemy.engines [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 10:56:20.384020 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG dbcounter [-] [105594] Writer thread running {{(pid=105594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 10:56:20.388466 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writer thread running {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 10:56:20.439500 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.context [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),51910246-b507-43fe-b5f6-535f38f61839(cell1) {{(pid=105594) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 10:56:20.443351 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG oslo_concurrency.lockutils [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 10:56:20.443827 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG oslo_concurrency.lockutils [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 10:56:20.444335 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.context [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),51910246-b507-43fe-b5f6-535f38f61839(cell1) {{(pid=105595) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 10:56:20.445415 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG oslo_concurrency.lockutils [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 10:56:20.446182 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG oslo_concurrency.lockutils [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 10:56:20.446638 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG oslo_concurrency.lockutils [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 10:56:20.448181 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 10:56:20.448640 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG oslo_concurrency.lockutils [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 10:56:20.448742 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 10:56:20.450899 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 10:56:20.451588 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO dbcounter [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] Registered counter for database nova_cell0 Aug 26 10:56:20.451691 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 10:56:20.452086 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 10:56:20.454088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 10:56:20.456106 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO dbcounter [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] Registered counter for database nova_cell0 Aug 26 10:56:20.456981 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO dbcounter [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] Registered counter for database nova_cell1 Aug 26 10:56:20.461463 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO dbcounter [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] Registered counter for database nova_cell1 Aug 26 10:56:20.464183 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG oslo_db.sqlalchemy.engines [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 10:56:20.465725 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG oslo_db.sqlalchemy.engines [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 10:56:20.468763 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_db.sqlalchemy.engines [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 10:56:20.472736 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG dbcounter [-] [105594] Writer thread running {{(pid=105594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 10:56:20.473179 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writer thread running {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 10:56:20.473818 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_db.sqlalchemy.engines [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 10:56:20.474534 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG dbcounter [-] [105594] Writer thread running {{(pid=105594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 10:56:20.619332 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writer thread running {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 10:56:20.627257 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO dbcounter [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] Registered counter for database nova_cell0 Aug 26 10:56:20.628633 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO dbcounter [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] Registered counter for database nova_cell0 Aug 26 10:56:20.635378 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG oslo_db.sqlalchemy.engines [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 10:56:20.639825 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_db.sqlalchemy.engines [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 10:56:20.640660 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG dbcounter [-] [105594] Writer thread running {{(pid=105594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 10:56:20.644315 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writer thread running {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 10:56:20.987933 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: WARNING keystonemiddleware.auth_token [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 10:56:20.991339 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: WARNING keystonemiddleware.auth_token [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 10:56:20.995186 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: WARNING keystonemiddleware.auth_token [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 10:56:20.999178 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: WARNING keystonemiddleware.auth_token [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 10:56:21.342704 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: WARNING keystonemiddleware.auth_token [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 10:56:21.348611 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: WARNING keystonemiddleware.auth_token [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 10:56:21.351708 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: WARNING keystonemiddleware.auth_token [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 10:56:21.353861 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bc972049c0 pid: 105595 (default app) Aug 26 10:56:21.355940 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:56:21.357289 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001859 Aug 26 10:56:21.357672 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: WARNING keystonemiddleware.auth_token [None req-a85921d7-2b53-43ba-937e-e43636537e19 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 10:56:21.357811 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Fri Aug 26 10:56:21 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:56:21.363298 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bc972049c0 pid: 105594 (default app) Aug 26 10:57:39.459129 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:57:39.460753 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002051 Aug 26 10:57:39.461323 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 10:57:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:57:39.477828 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG dbcounter [-] [105594] Writing DB stats nova_api:SELECT=3 {{(pid=105594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 10:57:39.478943 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG dbcounter [-] [105594] Writing DB stats nova_cell0:SELECT=3 {{(pid=105594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 10:57:39.479669 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG dbcounter [-] [105594] Writing DB stats nova_cell1:SELECT=3 {{(pid=105594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 10:57:39.480926 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG dbcounter [-] [105594] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 10:57:40.392673 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-a7e97a91-3b10-4b2e-8ff5-090fb60ee4dc admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:57:40.427341 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-a7e97a91-3b10-4b2e-8ff5-090fb60ee4dc admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.958426 Aug 26 10:57:40.428089 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1292 bytes} [Fri Aug 26 10:57:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 10:57:42.839013 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:57:42.840016 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-b30aaef6-b80b-4d7f-9108-5a307c0b7f33 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 26 10:57:42.841136 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 10:57:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:57:43.289128 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-4119f7ba-8e9a-427c-8b6f-c1a698259997 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1}} {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:57:43.344239 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-4119f7ba-8e9a-427c-8b6f-c1a698259997 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496752 Aug 26 10:57:43.345773 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 10:57:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 10:57:43.360776 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writing DB stats nova_api:SELECT=3 {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 10:57:43.362072 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writing DB stats nova_cell0:SELECT=3 {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 10:57:43.363162 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writing DB stats nova_cell1:SELECT=3 {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 10:57:43.364259 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 10:57:43.577416 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-e2ccee52-7a68-4af9-964d-231c44fa4257 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:57:43.644605 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-e2ccee52-7a68-4af9-964d-231c44fa4257 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290339 Aug 26 10:57:43.645207 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 26 10:57:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 10:57:46.015826 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-4119f7ba-8e9a-427c-8b6f-c1a698259997 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:57:46.016845 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-4119f7ba-8e9a-427c-8b6f-c1a698259997 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 26 10:57:46.017246 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 10:57:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:57:46.684528 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-ecb53058-6ed9-4dfe-a634-5e277fdc12f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "ram": 512, "name": "ds512M", "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "disk": 5}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:57:46.723176 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-ecb53058-6ed9-4dfe-a634-5e277fdc12f4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.699633 Aug 26 10:57:46.724370 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 10:57:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 10:57:46.736542 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-19fc392a-ae80-49b9-b9fe-bbda92b6cc65 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:57:46.773510 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-19fc392a-ae80-49b9-b9fe-bbda92b6cc65 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040556 Aug 26 10:57:46.774259 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 26 10:57:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 10:57:49.267359 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-ecb53058-6ed9-4dfe-a634-5e277fdc12f4 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:57:49.268401 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-ecb53058-6ed9-4dfe-a634-5e277fdc12f4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 26 10:57:49.268800 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 10:57:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:57:49.667974 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-bfaa2190-6bb6-46bf-9ec2-b98c6224175c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "rxtx_factor": 1.0, "id": "d2", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G"}} {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:57:49.688831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-bfaa2190-6bb6-46bf-9ec2-b98c6224175c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.413886 Aug 26 10:57:49.689403 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 10:57:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 10:57:49.702211 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-8a039b5b-409d-47e3-ae35-08b7c4b20db8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:57:49.725320 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-8a039b5b-409d-47e3-ae35-08b7c4b20db8 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027647 Aug 26 10:57:49.726225 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 26 10:57:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 10:57:52.075464 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-bfaa2190-6bb6-46bf-9ec2-b98c6224175c admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:57:52.076527 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-bfaa2190-6bb6-46bf-9ec2-b98c6224175c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 26 10:57:52.076961 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 10:57:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:57:52.552543 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-e8bdf927-6dd6-4c65-94c2-315f881c8538 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d3", "vcpus": 2, "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:57:52.571859 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-e8bdf927-6dd6-4c65-94c2-315f881c8538 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.488500 Aug 26 10:57:52.573020 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 10:57:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 10:57:52.586277 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-c4f6db7e-ca36-4839-a12e-d3c3816e6c8f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:57:52.611000 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-c4f6db7e-ca36-4839-a12e-d3c3816e6c8f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028672 Aug 26 10:57:52.611739 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 26 10:57:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 10:57:55.021525 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-e8bdf927-6dd6-4c65-94c2-315f881c8538 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:57:55.022525 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-e8bdf927-6dd6-4c65-94c2-315f881c8538 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Aug 26 10:57:55.023137 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 10:57:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:57:55.467744 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-470882d1-b020-461c-b47a-736abb40721c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "vcpus": 4, "ram": 4096, "disk": 20, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:57:55.487962 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-470882d1-b020-461c-b47a-736abb40721c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457230 Aug 26 10:57:55.488959 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 10:57:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 10:57:55.501449 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-d7615da9-30dd-4ab2-81a2-d14beea8812d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:57:55.525102 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-d7615da9-30dd-4ab2-81a2-d14beea8812d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027242 Aug 26 10:57:55.525653 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 26 10:57:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 10:57:57.991621 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-470882d1-b020-461c-b47a-736abb40721c admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:57:57.992674 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-470882d1-b020-461c-b47a-736abb40721c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 26 10:57:57.993082 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 10:57:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:57:58.420615 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-f4f6fa39-cc68-4fd1-be2c-42894d43dfef admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:57:58.452602 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-f4f6fa39-cc68-4fd1-be2c-42894d43dfef admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.452999 Aug 26 10:57:58.453499 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1292 bytes} [Fri Aug 26 10:57:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 10:58:01.106114 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-470882d1-b020-461c-b47a-736abb40721c admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:01.107145 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-470882d1-b020-461c-b47a-736abb40721c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 26 10:58:01.107555 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 10:58:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:58:01.577081 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-bbfa3745-9cd4-424a-92f2-8326f6de1ac3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "ram": 512, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:58:01.596556 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-bbfa3745-9cd4-424a-92f2-8326f6de1ac3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.482546 Aug 26 10:58:01.597367 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 10:58:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 10:58:01.609682 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-29c3c54d-f2ee-49f4-bc92-5d13bcc81297 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:58:01.633467 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-29c3c54d-f2ee-49f4-bc92-5d13bcc81297 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028114 Aug 26 10:58:01.634092 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 26 10:58:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 10:58:03.970281 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-bbfa3745-9cd4-424a-92f2-8326f6de1ac3 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:03.971442 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-bbfa3745-9cd4-424a-92f2-8326f6de1ac3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 Aug 26 10:58:03.971847 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 10:58:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:58:04.383205 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-48b76a24-0bc5-40bd-b8d5-9ce372227ca9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "2", "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "ram": 2048, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:58:04.403153 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-48b76a24-0bc5-40bd-b8d5-9ce372227ca9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.425157 Aug 26 10:58:04.403642 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 10:58:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 10:58:04.415901 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-7da380a7-412e-45b0-937f-faeb132de687 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:58:04.440812 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-7da380a7-412e-45b0-937f-faeb132de687 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028610 Aug 26 10:58:04.441383 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 26 10:58:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 10:58:06.832795 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-48b76a24-0bc5-40bd-b8d5-9ce372227ca9 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:06.834546 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-48b76a24-0bc5-40bd-b8d5-9ce372227ca9 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002175 Aug 26 10:58:06.834952 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 10:58:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:58:07.217132 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-4928877f-cc63-4ef4-817a-8d357897e8de admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "name": "m1.medium", "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:58:07.236515 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-4928877f-cc63-4ef4-817a-8d357897e8de admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.392844 Aug 26 10:58:07.237161 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 10:58:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 10:58:07.250652 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-834cd0cf-8684-425b-8bc1-56b9d9270592 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:58:07.276458 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-834cd0cf-8684-425b-8bc1-56b9d9270592 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030600 Aug 26 10:58:07.277041 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 26 10:58:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 10:58:09.694149 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-4928877f-cc63-4ef4-817a-8d357897e8de admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:09.695195 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-4928877f-cc63-4ef4-817a-8d357897e8de admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Aug 26 10:58:09.695627 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 10:58:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:58:10.173456 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-eeecd69e-bf50-4c16-bc4d-70abb6f2f1d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 80, "rxtx_factor": 1.0, "ram": 8192, "vcpus": 4}} {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:58:10.180532 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG dbcounter [-] [105594] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 10:58:10.201913 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-eeecd69e-bf50-4c16-bc4d-70abb6f2f1d5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.500280 Aug 26 10:58:10.202731 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 10:58:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 10:58:10.214677 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-d87a7046-3c2a-4312-b8b0-acb80090acf9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:58:10.240904 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-d87a7046-3c2a-4312-b8b0-acb80090acf9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029895 Aug 26 10:58:10.241581 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 26 10:58:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 10:58:12.636712 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-eeecd69e-bf50-4c16-bc4d-70abb6f2f1d5 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:12.637724 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-eeecd69e-bf50-4c16-bc4d-70abb6f2f1d5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 26 10:58:12.638431 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 10:58:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:58:13.101873 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-f9617477-4f2d-4979-925c-14fe86fc3807 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:58:13.123074 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-f9617477-4f2d-4979-925c-14fe86fc3807 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.478113 Aug 26 10:58:13.124100 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 10:58:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 10:58:13.136170 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-03dcfda3-7b49-4102-a9a5-a4156f4ce011 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:58:13.164860 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-03dcfda3-7b49-4102-a9a5-a4156f4ce011 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032790 Aug 26 10:58:13.165558 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 26 10:58:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 10:58:31.702720 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-f9617477-4f2d-4979-925c-14fe86fc3807 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:31.703731 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-f9617477-4f2d-4979-925c-14fe86fc3807 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 26 10:58:31.704132 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 10:58:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:58:31.714319 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG dbcounter [-] [105594] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 10:58:32.099129 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-0442090e-f4ae-414b-af85-76eccd65ed04 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:32.117077 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-0442090e-f4ae-414b-af85-76eccd65ed04 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.407132 Aug 26 10:58:32.117609 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1292 bytes} [Fri Aug 26 10:58:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 10:58:33.168738 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-f9617477-4f2d-4979-925c-14fe86fc3807 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:33.170410 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-f9617477-4f2d-4979-925c-14fe86fc3807 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002056 Aug 26 10:58:33.170809 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 10:58:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:58:33.688323 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-af0d1664-d647-4f57-8f64-6a1150442990 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:33.693786 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.wsgi [None req-af0d1664-d647-4f57-8f64-6a1150442990 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-af0d1664-d647-4f57-8f64-6a1150442990 admin admin] Request method failure captured: Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Accept: application/json Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Accept-Encoding: gzip, deflate Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Connection: keep-alive Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Content-Length: 0 Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Host: 10.222.0.40 Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Openstack-Api-Version: compute 2.90 Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Openstack-System-Scope: None Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: User-Agent: python-novaclient Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Auth-Token: gAAAAABjCKdZyocyRrdXQgIQDgGsNUBv_rOcnfxlzSEQTMpETArnzAUNYykyqPhNnmF9KSWw1xozKJxJS_6dxAXCtBXuSQDV2GkoZxFpSdji0mYTlejLo1nd4RLX8TWxTIweAj104zLbFGDMtCCKrz24jVADAP0ko1Zg01SxBreeCZWnQ0aCGcU Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Domain-Id: None Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Domain-Name: None Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Identity-Status: Confirmed Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Is-Admin-Project: True Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Project-Domain-Id: default Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Project-Domain-Name: Default Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Project-Id: f3942b05c97e4a1ca048ce3a0379b7a7 Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Project-Name: admin Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Role: admin,member,reader Aug 26 10:58:33.696987 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Roles: admin,member,reader Aug 26 10:58:33.698708 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3942b05c97e4a1ca048ce3a0379b7a7"}]}] Aug 26 10:58:33.698708 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Tenant: admin Aug 26 10:58:33.698708 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Tenant-Id: f3942b05c97e4a1ca048ce3a0379b7a7 Aug 26 10:58:33.698708 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Tenant-Name: admin Aug 26 10:58:33.698708 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-User: admin Aug 26 10:58:33.698708 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-User-Domain-Id: default Aug 26 10:58:33.698708 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-User-Domain-Name: Default Aug 26 10:58:33.698708 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-User-Id: ca155a48e2024c32af3fd2e19e5fac11 Aug 26 10:58:33.698708 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-User-Name: admin Aug 26 10:58:33.698708 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: method: > Aug 26 10:58:33.698708 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: exception: Flavor 42 could not be found. Aug 26 10:58:33.698708 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: action_args: {'id': '42'} Aug 26 10:58:33.698708 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 10:58:33.698708 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 10:58:33.699783 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Aug 26 10:58:33.702061 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-af0d1664-d647-4f57-8f64-6a1150442990 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 10:58:33.703390 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-af0d1664-d647-4f57-8f64-6a1150442990 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390484 Aug 26 10:58:33.703390 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Aug 26 10:58:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 26 10:58:33.708361 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-4c5722ad-4b00-4cf7-9b74-f27070dfefcb admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:33.712537 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 10:58:33.732119 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-4c5722ad-4b00-4cf7-9b74-f27070dfefcb admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027202 Aug 26 10:58:33.732844 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 26 10:58:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 10:58:33.742658 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-7edf8cf0-be59-47e4-b61f-db46dfc0aa2b admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:33.766962 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-7edf8cf0-be59-47e4-b61f-db46dfc0aa2b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028046 Aug 26 10:58:33.767489 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 26 10:58:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 10:58:33.776819 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-ddbb0060-f3a1-4884-a5b2-cec475351468 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:33.783047 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.wsgi [None req-ddbb0060-f3a1-4884-a5b2-cec475351468 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-ddbb0060-f3a1-4884-a5b2-cec475351468 admin admin] Request method failure captured: Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Accept: application/json Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Accept-Encoding: gzip, deflate Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Connection: keep-alive Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Content-Length: 0 Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Host: 10.222.0.40 Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Openstack-Api-Version: compute 2.90 Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Openstack-System-Scope: None Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: User-Agent: python-novaclient Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Auth-Token: gAAAAABjCKdZyocyRrdXQgIQDgGsNUBv_rOcnfxlzSEQTMpETArnzAUNYykyqPhNnmF9KSWw1xozKJxJS_6dxAXCtBXuSQDV2GkoZxFpSdji0mYTlejLo1nd4RLX8TWxTIweAj104zLbFGDMtCCKrz24jVADAP0ko1Zg01SxBreeCZWnQ0aCGcU Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Domain-Id: None Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Domain-Name: None Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Identity-Status: Confirmed Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Is-Admin-Project: True Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Project-Domain-Id: default Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Project-Domain-Name: Default Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Project-Id: f3942b05c97e4a1ca048ce3a0379b7a7 Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Project-Name: admin Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Role: admin,member,reader Aug 26 10:58:33.786245 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Roles: admin,member,reader Aug 26 10:58:33.787744 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3942b05c97e4a1ca048ce3a0379b7a7"}]}] Aug 26 10:58:33.787744 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Tenant: admin Aug 26 10:58:33.787744 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Tenant-Id: f3942b05c97e4a1ca048ce3a0379b7a7 Aug 26 10:58:33.787744 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Tenant-Name: admin Aug 26 10:58:33.787744 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-User: admin Aug 26 10:58:33.787744 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-User-Domain-Id: default Aug 26 10:58:33.787744 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-User-Domain-Name: Default Aug 26 10:58:33.787744 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-User-Id: ca155a48e2024c32af3fd2e19e5fac11 Aug 26 10:58:33.787744 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-User-Name: admin Aug 26 10:58:33.787744 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: method: > Aug 26 10:58:33.787744 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: exception: Flavor 42 could not be found. Aug 26 10:58:33.787744 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: action_args: {'id': '42'} Aug 26 10:58:33.787744 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 10:58:33.787744 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 10:58:33.788734 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Aug 26 10:58:33.790156 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-ddbb0060-f3a1-4884-a5b2-cec475351468 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 10:58:33.791343 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-ddbb0060-f3a1-4884-a5b2-cec475351468 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014298 Aug 26 10:58:33.791343 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Aug 26 10:58:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 26 10:58:34.759330 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-7edf8cf0-be59-47e4-b61f-db46dfc0aa2b admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:34.760335 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-7edf8cf0-be59-47e4-b61f-db46dfc0aa2b admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 26 10:58:34.760731 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 10:58:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:58:35.280575 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-69c2cb93-ea44-45ff-9237-b33bb477fdb8 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:35.285815 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.wsgi [None req-69c2cb93-ea44-45ff-9237-b33bb477fdb8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-69c2cb93-ea44-45ff-9237-b33bb477fdb8 admin admin] Request method failure captured: Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Accept: application/json Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Accept-Encoding: gzip, deflate Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Connection: keep-alive Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Content-Length: 0 Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Host: 10.222.0.40 Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Openstack-Api-Version: compute 2.90 Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Openstack-System-Scope: None Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: User-Agent: python-novaclient Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Auth-Token: gAAAAABjCKdaFfRoppOuFMnv_999ipyp_B4hq4QwGgW2aSWcLceI8umkh22OEi3bmIZpLhjVZY_BFuoJDT06cyys_PRzTzexZBkwoNg0VYm92rrVADFiW_3u6l4riJrqFMyxHgK4hkICFh0K9PIUzOwwiPfIXc49JoDrfiVcpqZrUfSUCSZPxG8 Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Domain-Id: None Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Domain-Name: None Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Identity-Status: Confirmed Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Is-Admin-Project: True Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Project-Domain-Id: default Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Project-Domain-Name: Default Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Project-Id: f3942b05c97e4a1ca048ce3a0379b7a7 Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Project-Name: admin Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Role: admin,member,reader Aug 26 10:58:35.287355 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Roles: admin,member,reader Aug 26 10:58:35.288881 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3942b05c97e4a1ca048ce3a0379b7a7"}]}] Aug 26 10:58:35.288881 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Tenant: admin Aug 26 10:58:35.288881 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Tenant-Id: f3942b05c97e4a1ca048ce3a0379b7a7 Aug 26 10:58:35.288881 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Tenant-Name: admin Aug 26 10:58:35.288881 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-User: admin Aug 26 10:58:35.288881 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-User-Domain-Id: default Aug 26 10:58:35.288881 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-User-Domain-Name: Default Aug 26 10:58:35.288881 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-User-Id: ca155a48e2024c32af3fd2e19e5fac11 Aug 26 10:58:35.288881 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-User-Name: admin Aug 26 10:58:35.288881 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: method: > Aug 26 10:58:35.288881 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: exception: Flavor 84 could not be found. Aug 26 10:58:35.288881 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: action_args: {'id': '84'} Aug 26 10:58:35.288881 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 10:58:35.288881 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 10:58:35.289784 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Aug 26 10:58:35.291088 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-69c2cb93-ea44-45ff-9237-b33bb477fdb8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 10:58:35.292382 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-69c2cb93-ea44-45ff-9237-b33bb477fdb8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.390288 Aug 26 10:58:35.292382 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Aug 26 10:58:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 10:58:35.300538 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-3421c79d-2aba-4c2d-9d3b-ab3e9b8f4907 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:35.316133 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-3421c79d-2aba-4c2d-9d3b-ab3e9b8f4907 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020470 Aug 26 10:58:35.316676 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 26 10:58:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 10:58:35.326243 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-9718cf82-afef-4a26-a4dd-dc2031e027af admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:35.341775 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-9718cf82-afef-4a26-a4dd-dc2031e027af admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018482 Aug 26 10:58:35.342392 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 26 10:58:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 10:58:35.351526 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-b4b0c509-970b-4cb3-9e8d-b26727c7906d admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:35.357385 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.wsgi [None req-b4b0c509-970b-4cb3-9e8d-b26727c7906d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-b4b0c509-970b-4cb3-9e8d-b26727c7906d admin admin] Request method failure captured: Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Accept: application/json Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Accept-Encoding: gzip, deflate Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Connection: keep-alive Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Content-Length: 0 Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Host: 10.222.0.40 Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Openstack-Api-Version: compute 2.90 Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Openstack-System-Scope: None Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: User-Agent: python-novaclient Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Auth-Token: gAAAAABjCKdaFfRoppOuFMnv_999ipyp_B4hq4QwGgW2aSWcLceI8umkh22OEi3bmIZpLhjVZY_BFuoJDT06cyys_PRzTzexZBkwoNg0VYm92rrVADFiW_3u6l4riJrqFMyxHgK4hkICFh0K9PIUzOwwiPfIXc49JoDrfiVcpqZrUfSUCSZPxG8 Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Domain-Id: None Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Domain-Name: None Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Identity-Status: Confirmed Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Is-Admin-Project: True Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Project-Domain-Id: default Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Project-Domain-Name: Default Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Project-Id: f3942b05c97e4a1ca048ce3a0379b7a7 Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Project-Name: admin Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Role: admin,member,reader Aug 26 10:58:35.358914 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Roles: admin,member,reader Aug 26 10:58:35.360631 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3942b05c97e4a1ca048ce3a0379b7a7"}]}] Aug 26 10:58:35.360631 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Tenant: admin Aug 26 10:58:35.360631 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Tenant-Id: f3942b05c97e4a1ca048ce3a0379b7a7 Aug 26 10:58:35.360631 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Tenant-Name: admin Aug 26 10:58:35.360631 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-User: admin Aug 26 10:58:35.360631 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-User-Domain-Id: default Aug 26 10:58:35.360631 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-User-Domain-Name: Default Aug 26 10:58:35.360631 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-User-Id: ca155a48e2024c32af3fd2e19e5fac11 Aug 26 10:58:35.360631 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-User-Name: admin Aug 26 10:58:35.360631 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: method: > Aug 26 10:58:35.360631 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: exception: Flavor 84 could not be found. Aug 26 10:58:35.360631 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: action_args: {'id': '84'} Aug 26 10:58:35.360631 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 10:58:35.360631 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 10:58:35.361624 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Aug 26 10:58:35.362831 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-b4b0c509-970b-4cb3-9e8d-b26727c7906d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 10:58:35.364127 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-b4b0c509-970b-4cb3-9e8d-b26727c7906d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012297 Aug 26 10:58:35.364127 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Aug 26 10:58:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 10:58:36.314736 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-9718cf82-afef-4a26-a4dd-dc2031e027af admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:36.315745 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-9718cf82-afef-4a26-a4dd-dc2031e027af admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 26 10:58:36.316148 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 10:58:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:58:36.839689 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-cfd033cb-3e37-4f80-9a3c-dab5429520d6 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:36.845830 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.wsgi [None req-cfd033cb-3e37-4f80-9a3c-dab5429520d6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-cfd033cb-3e37-4f80-9a3c-dab5429520d6 admin admin] Request method failure captured: Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Accept: application/json Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Accept-Encoding: gzip, deflate Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Connection: keep-alive Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Content-Length: 0 Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Host: 10.222.0.40 Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Openstack-Api-Version: compute 2.90 Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Openstack-System-Scope: None Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: User-Agent: python-novaclient Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Auth-Token: gAAAAABjCKdcoHNZB_oPhcIsz_rdzBPjeVXjn3Smtk3DsEkdmBETtuZOmLTcDgDkQplAAmLKunCMIETTojntQOvrFSXeW9e6AsbNBvjEbrsoqy--UKRfpkphneQ0j5IY-u46xlQ5LEvHn6HqcGrG5vT9fT0q66sM0-rIHPefVgXbrKaUH9GL-tI Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Domain-Id: None Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Domain-Name: None Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Identity-Status: Confirmed Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Is-Admin-Project: True Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Project-Domain-Id: default Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Project-Domain-Name: Default Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Project-Id: f3942b05c97e4a1ca048ce3a0379b7a7 Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Project-Name: admin Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Role: admin,member,reader Aug 26 10:58:36.847345 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Roles: admin,member,reader Aug 26 10:58:36.848892 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3942b05c97e4a1ca048ce3a0379b7a7"}]}] Aug 26 10:58:36.848892 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Tenant: admin Aug 26 10:58:36.848892 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Tenant-Id: f3942b05c97e4a1ca048ce3a0379b7a7 Aug 26 10:58:36.848892 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-Tenant-Name: admin Aug 26 10:58:36.848892 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-User: admin Aug 26 10:58:36.848892 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-User-Domain-Id: default Aug 26 10:58:36.848892 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-User-Domain-Name: Default Aug 26 10:58:36.848892 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-User-Id: ca155a48e2024c32af3fd2e19e5fac11 Aug 26 10:58:36.848892 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: X-User-Name: admin Aug 26 10:58:36.848892 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: method: > Aug 26 10:58:36.848892 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: exception: Flavor 451 could not be found. Aug 26 10:58:36.848892 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: action_args: {'id': '451'} Aug 26 10:58:36.848892 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 10:58:36.848892 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 10:58:36.849939 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: ERROR nova.api.openstack.wsgi Aug 26 10:58:36.851236 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-cfd033cb-3e37-4f80-9a3c-dab5429520d6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 10:58:36.852448 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-cfd033cb-3e37-4f80-9a3c-dab5429520d6 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395898 Aug 26 10:58:36.852448 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 26 10:58:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 10:58:36.859110 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-a8a79853-cc64-4b5b-85da-6bb11e6c7921 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:36.874153 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-a8a79853-cc64-4b5b-85da-6bb11e6c7921 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019182 Aug 26 10:58:36.874702 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 26 10:58:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 10:58:36.884348 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-b32bc7ff-1bde-4ec6-918f-473ae80345c3 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:36.899710 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-b32bc7ff-1bde-4ec6-918f-473ae80345c3 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018842 Aug 26 10:58:36.900492 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 26 10:58:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 10:58:36.910596 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-3ae47e1e-3885-461c-99b6-58cc96f03ca5 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:36.915961 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.wsgi [None req-3ae47e1e-3885-461c-99b6-58cc96f03ca5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-3ae47e1e-3885-461c-99b6-58cc96f03ca5 admin admin] Request method failure captured: Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Accept: application/json Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Accept-Encoding: gzip, deflate Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Connection: keep-alive Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Content-Length: 0 Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Host: 10.222.0.40 Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Openstack-Api-Version: compute 2.90 Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Openstack-System-Scope: None Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: User-Agent: python-novaclient Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Auth-Token: gAAAAABjCKdcoHNZB_oPhcIsz_rdzBPjeVXjn3Smtk3DsEkdmBETtuZOmLTcDgDkQplAAmLKunCMIETTojntQOvrFSXeW9e6AsbNBvjEbrsoqy--UKRfpkphneQ0j5IY-u46xlQ5LEvHn6HqcGrG5vT9fT0q66sM0-rIHPefVgXbrKaUH9GL-tI Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Domain-Id: None Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Domain-Name: None Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Identity-Status: Confirmed Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Is-Admin-Project: True Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Project-Domain-Id: default Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Project-Domain-Name: Default Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Project-Id: f3942b05c97e4a1ca048ce3a0379b7a7 Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Project-Name: admin Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Role: admin,member,reader Aug 26 10:58:36.917441 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Roles: admin,member,reader Aug 26 10:58:36.919164 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3942b05c97e4a1ca048ce3a0379b7a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f3942b05c97e4a1ca048ce3a0379b7a7"}]}] Aug 26 10:58:36.919164 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Tenant: admin Aug 26 10:58:36.919164 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Tenant-Id: f3942b05c97e4a1ca048ce3a0379b7a7 Aug 26 10:58:36.919164 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-Tenant-Name: admin Aug 26 10:58:36.919164 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-User: admin Aug 26 10:58:36.919164 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-User-Domain-Id: default Aug 26 10:58:36.919164 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-User-Domain-Name: Default Aug 26 10:58:36.919164 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-User-Id: ca155a48e2024c32af3fd2e19e5fac11 Aug 26 10:58:36.919164 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: X-User-Name: admin Aug 26 10:58:36.919164 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: method: > Aug 26 10:58:36.919164 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: exception: Flavor 451 could not be found. Aug 26 10:58:36.919164 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: action_args: {'id': '451'} Aug 26 10:58:36.919164 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 10:58:36.919164 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 10:58:36.919968 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: ERROR nova.api.openstack.wsgi Aug 26 10:58:36.921728 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-3ae47e1e-3885-461c-99b6-58cc96f03ca5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 10:58:36.924510 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-3ae47e1e-3885-461c-99b6-58cc96f03ca5 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011956 Aug 26 10:58:36.926353 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 26 10:58:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 10:58:37.896913 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-b32bc7ff-1bde-4ec6-918f-473ae80345c3 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:37.897983 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-b32bc7ff-1bde-4ec6-918f-473ae80345c3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 26 10:58:37.898393 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 10:58:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 10:58:38.426453 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-e35a5b29-cdbe-42fa-83e5-03e41d1443ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:58:38.445501 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-e35a5b29-cdbe-42fa-83e5-03e41d1443ca admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.405533 Aug 26 10:58:38.446054 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Aug 26 10:58:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 10:58:39.424913 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-b32bc7ff-1bde-4ec6-918f-473ae80345c3 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:39.425925 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-b32bc7ff-1bde-4ec6-918f-473ae80345c3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 26 10:58:39.426352 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 10:58:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:58:39.958454 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-e0fa0f35-3238-43c9-90d7-ceb82e45d280 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:58:39.976879 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-e0fa0f35-3238-43c9-90d7-ceb82e45d280 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.412868 Aug 26 10:58:39.977422 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Aug 26 10:58:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 10:58:40.960021 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-b32bc7ff-1bde-4ec6-918f-473ae80345c3 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:40.961020 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-b32bc7ff-1bde-4ec6-918f-473ae80345c3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 26 10:58:40.961413 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 10:58:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:58:41.484447 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-04cf96e9-b692-4f89-ae48-8d5cfc87eb45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:58:41.503300 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-04cf96e9-b692-4f89-ae48-8d5cfc87eb45 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.403250 Aug 26 10:58:41.503841 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Aug 26 10:58:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 10:58:42.470830 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-b32bc7ff-1bde-4ec6-918f-473ae80345c3 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:42.471846 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-b32bc7ff-1bde-4ec6-918f-473ae80345c3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 26 10:58:42.472245 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 10:58:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:58:43.003640 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-483ec32e-b6b4-474d-83de-fecbdfb802db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 10:58:43.022231 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-483ec32e-b6b4-474d-83de-fecbdfb802db admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.403940 Aug 26 10:58:43.022782 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Aug 26 10:58:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 10:58:43.995361 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-b32bc7ff-1bde-4ec6-918f-473ae80345c3 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:43.996390 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-b32bc7ff-1bde-4ec6-918f-473ae80345c3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 26 10:58:43.996784 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 10:58:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:58:44.521922 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-6ce78e8b-1fec-4138-b506-6e34159a6892 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:58:44.542614 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-6ce78e8b-1fec-4138-b506-6e34159a6892 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.408816 Aug 26 10:58:44.543150 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Fri Aug 26 10:58:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 10:59:37.944778 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-b32bc7ff-1bde-4ec6-918f-473ae80345c3 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:59:37.945797 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-b32bc7ff-1bde-4ec6-918f-473ae80345c3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 26 10:59:37.946248 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 10:59:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 10:59:37.956733 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 10:59:38.347485 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-d36f2ddb-9af1-46a6-9422-c456e0254a98 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:59:38.368646 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-d36f2ddb-9af1-46a6-9422-c456e0254a98 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.416306 Aug 26 10:59:38.369176 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1292 bytes} [Fri Aug 26 10:59:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 10:59:38.390219 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG dbcounter [-] [105594] Writing DB stats nova_api:SELECT=14 {{(pid=105594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 10:59:38.394038 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-6342cf77-1f4a-4ea8-9adf-918fa9c0c598 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:59:38.402993 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-6342cf77-1f4a-4ea8-9adf-918fa9c0c598 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013134 Aug 26 10:59:38.403506 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1283 bytes} [Fri Aug 26 10:59:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 10:59:38.414990 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-daf6ce24-8916-4878-8eb2-c3b63c94cf9a admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:59:38.423174 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-daf6ce24-8916-4878-8eb2-c3b63c94cf9a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011820 Aug 26 10:59:38.423719 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1286 bytes} [Fri Aug 26 10:59:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 10:59:38.434635 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-1d573dbb-a7b2-45b2-a00f-78c3a37a3e10 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:59:38.442325 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-1d573dbb-a7b2-45b2-a00f-78c3a37a3e10 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010852 Aug 26 10:59:38.442845 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1286 bytes} [Fri Aug 26 10:59:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 10:59:38.453959 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-52afd32c-1a24-453e-84c3-bbf1dfa0f9a1 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 10:59:38.461301 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-52afd32c-1a24-453e-84c3-bbf1dfa0f9a1 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010800 Aug 26 10:59:38.461811 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1283 bytes} [Fri Aug 26 10:59:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:02:36.634552 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-1d573dbb-a7b2-45b2-a00f-78c3a37a3e10 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:02:36.635590 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-1d573dbb-a7b2-45b2-a00f-78c3a37a3e10 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Aug 26 11:02:36.635997 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 11:02:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:02:36.777655 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writing DB stats nova_api:SELECT=6 {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:02:36.945066 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-fa6c3cca-3ad2-4e32-a509-2d1fa7aa94b9 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:02:36.948592 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-fa6c3cca-3ad2-4e32-a509-2d1fa7aa94b9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:02:36.949062 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-fa6c3cca-3ad2-4e32-a509-2d1fa7aa94b9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:02:36.949486 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-fa6c3cca-3ad2-4e32-a509-2d1fa7aa94b9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:02:36.950213 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-fa6c3cca-3ad2-4e32-a509-2d1fa7aa94b9 admin admin] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:02:36.950711 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-fa6c3cca-3ad2-4e32-a509-2d1fa7aa94b9 admin admin] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:02:36.951060 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-fa6c3cca-3ad2-4e32-a509-2d1fa7aa94b9 admin admin] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:02:36.986537 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-fa6c3cca-3ad2-4e32-a509-2d1fa7aa94b9 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.210328 Aug 26 11:02:36.987097 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 26 11:02:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 11:02:37.813626 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-1d573dbb-a7b2-45b2-a00f-78c3a37a3e10 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:02:37.814683 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-1d573dbb-a7b2-45b2-a00f-78c3a37a3e10 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 26 11:02:37.815118 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 11:02:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:02:38.011236 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-63286051-529f-40fc-a6e7-433c8b4d0036 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:02:38.014706 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-63286051-529f-40fc-a6e7-433c8b4d0036 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:02:38.015192 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-63286051-529f-40fc-a6e7-433c8b4d0036 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:02:38.015629 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-63286051-529f-40fc-a6e7-433c8b4d0036 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:02:38.016352 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-63286051-529f-40fc-a6e7-433c8b4d0036 admin admin] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:02:38.016804 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-63286051-529f-40fc-a6e7-433c8b4d0036 admin admin] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:02:38.017614 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-63286051-529f-40fc-a6e7-433c8b4d0036 admin admin] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:02:38.039740 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-63286051-529f-40fc-a6e7-433c8b4d0036 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.084589 Aug 26 11:02:38.040239 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 26 11:02:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 11:02:49.289393 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-1d573dbb-a7b2-45b2-a00f-78c3a37a3e10 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:02:49.290496 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-1d573dbb-a7b2-45b2-a00f-78c3a37a3e10 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002199 Aug 26 11:02:49.290925 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 11:02:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:02:49.436346 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writing DB stats nova_cell0:SELECT=4 {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:02:49.437057 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writing DB stats nova_cell1:SELECT=4 {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:02:49.437660 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG dbcounter [-] [105595] Writing DB stats nova_api:SELECT=8 {{(pid=105595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:02:49.486433 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-26ee5e67-74bf-4895-93ef-9d430c809ce6 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:02:49.489755 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-26ee5e67-74bf-4895-93ef-9d430c809ce6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:02:49.490520 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-26ee5e67-74bf-4895-93ef-9d430c809ce6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:02:49.490947 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-26ee5e67-74bf-4895-93ef-9d430c809ce6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:02:49.492181 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-26ee5e67-74bf-4895-93ef-9d430c809ce6 admin admin] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:02:49.492627 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-26ee5e67-74bf-4895-93ef-9d430c809ce6 admin admin] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:02:49.493044 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-26ee5e67-74bf-4895-93ef-9d430c809ce6 admin admin] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:02:49.518255 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-26ee5e67-74bf-4895-93ef-9d430c809ce6 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086153 Aug 26 11:02:49.518736 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 26 11:02:49 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:02:50.351837 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: DEBUG nova.api.openstack.wsgi [None req-1d573dbb-a7b2-45b2-a00f-78c3a37a3e10 admin admin] Calling method '>' {{(pid=105594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:02:50.353143 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: INFO nova.api.openstack.requestlog [None req-1d573dbb-a7b2-45b2-a00f-78c3a37a3e10 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 Aug 26 11:02:50.353542 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: [pid: 105594|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 11:02:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:02:50.547636 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG nova.api.openstack.wsgi [None req-a1c98e21-70f9-453f-b983-f59c075aecf5 admin admin] Calling method '>' {{(pid=105595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:02:50.551309 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-a1c98e21-70f9-453f-b983-f59c075aecf5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:02:50.551785 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-a1c98e21-70f9-453f-b983-f59c075aecf5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:02:50.552218 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-a1c98e21-70f9-453f-b983-f59c075aecf5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:02:50.553015 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-a1c98e21-70f9-453f-b983-f59c075aecf5 admin admin] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:02:50.553462 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-a1c98e21-70f9-453f-b983-f59c075aecf5 admin admin] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:02:50.553878 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: DEBUG oslo_concurrency.lockutils [None req-a1c98e21-70f9-453f-b983-f59c075aecf5 admin admin] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:02:50.576309 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: INFO nova.api.openstack.requestlog [None req-a1c98e21-70f9-453f-b983-f59c075aecf5 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079761 Aug 26 11:02:50.576799 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: [pid: 105595|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 26 11:02:50 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:03:48.760329 dv-cinder-852369-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 26 11:03:48.761186 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: Fri Aug 26 11:03:48 2022 - graceful shutdown triggered... Aug 26 11:03:48.761695 dv-cinder-852369-2-iscsi devstack@n-api.service[105594]: Gracefully killing worker 1 (pid: 105594)... Aug 26 11:03:48.762214 dv-cinder-852369-2-iscsi devstack@n-api.service[105595]: Gracefully killing worker 2 (pid: 105595)... Aug 26 11:03:49.762329 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: worker 1 buried after 1 seconds Aug 26 11:03:49.762894 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: worker 2 buried after 1 seconds Aug 26 11:03:49.762894 dv-cinder-852369-2-iscsi devstack@n-api.service[105593]: goodbye to uWSGI. Aug 26 11:03:49.763969 dv-cinder-852369-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 26 11:03:49.764520 dv-cinder-852369-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 26 11:03:49.767354 dv-cinder-852369-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 26 11:03:49.778001 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 26 11:03:49.780020 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 11:03:49 2022] *** Aug 26 11:03:49.780020 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 11:03:49.780020 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 11:03:49.780020 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: nodename: dv-cinder-852369-2-iscsi Aug 26 11:03:49.780020 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: machine: x86_64 Aug 26 11:03:49.780020 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: clock source: unix Aug 26 11:03:49.780020 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: pcre jit disabled Aug 26 11:03:49.780020 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: detected number of CPU cores: 4 Aug 26 11:03:49.780020 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: current working directory: / Aug 26 11:03:49.780020 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: detected binary path: /usr/bin/uwsgi-core Aug 26 11:03:49.780020 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: your processes number limit is 47680 Aug 26 11:03:49.780882 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: your memory page size is 4096 bytes Aug 26 11:03:49.780882 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: detected max file descriptor number: 2048 Aug 26 11:03:49.780882 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: lock engine: pthread robust mutexes Aug 26 11:03:49.780882 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: thunder lock: enabled Aug 26 11:03:49.780882 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 26 11:03:49.780882 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 11:03:49.822568 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: Python main interpreter initialized at 0x5620edc839c0 Aug 26 11:03:49.822568 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: python threads support enabled Aug 26 11:03:49.822568 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: your server socket listen backlog is limited to 100 connections Aug 26 11:03:49.822568 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: your mercy for graceful operations on workers is 90 seconds Aug 26 11:03:49.823162 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 11:03:49.823276 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: *** Operational MODE: preforking *** Aug 26 11:03:49.823514 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: *** uWSGI is running in multiple interpreter mode *** Aug 26 11:03:49.823514 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: spawned uWSGI master process (pid: 120590) Aug 26 11:03:49.826455 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: spawned uWSGI worker 1 (pid: 120604, cores: 1) Aug 26 11:03:49.826455 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: spawned uWSGI worker 2 (pid: 120605, cores: 1) Aug 26 11:03:49.826455 dv-cinder-852369-2-iscsi devstack@n-api.service[120590]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 11:03:49.823713 dv-cinder-852369-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 26 11:03:50.489338 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 11:03:50.501690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 11:03:51.659273 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 11:03:51.659273 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: from cryptography.utils import int_from_bytes Aug 26 11:03:51.660007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 11:03:51.660007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: from cryptography.utils import int_from_bytes Aug 26 11:03:51.687801 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 11:03:51.687801 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: from cryptography.utils import int_from_bytes Aug 26 11:03:51.688393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 11:03:51.688393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: from cryptography.utils import int_from_bytes Aug 26 11:03:54.099158 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 11:03:54.099734 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 11:03:54.100013 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 11:03:54.100228 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 11:03:54.100488 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 11:03:54.100885 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.101215 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.101548 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.102497 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.103005 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.103324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.103657 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.103985 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.104321 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.104594 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.104914 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.105249 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852369-2-iscsi {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.105580 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.105881 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.106229 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.106556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.106862 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.107187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.107493 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.108007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.109422 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.109422 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.109422 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.109828 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.110148 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.110469 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.110778 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.111106 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.111421 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.111730 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.112166 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852369-2-iscsi {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.112499 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.112808 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.113119 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.113566 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.113877 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.114236 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.114573 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.114892 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.115205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.115538 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.116132 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.116458 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.116803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.117095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.117449 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.117755 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.118285 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.118610 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.118923 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.119178 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.119492 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.119820 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.120147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.120476 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.120730 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.120983 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.121304 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.121627 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.121941 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.122294 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.122601 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.122911 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.123219 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.123529 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.123838 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.124142 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.124466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.124786 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.125113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.125422 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.125746 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.126184 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.126455 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.126753 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.127096 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.127418 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.127725 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.128046 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.128368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.128677 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.128986 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.129290 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.129612 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.129949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.130280 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.130531 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.130835 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.131141 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.131462 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.131767 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.132074 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.132378 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.132677 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.133090 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.133465 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.133775 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.134106 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.134413 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.134723 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.135028 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.135334 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.135638 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.135957 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.136276 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.136583 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.136888 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.137197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.139846 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.139846 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.139846 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.139846 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.139846 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.139846 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.139846 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.140402 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.140402 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.140549 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.140829 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.140992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 11:03:54.141430 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 11:03:54.141786 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 11:03:54.141920 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.142183 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 11:03:54.142315 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.142491 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 11:03:54.142613 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.142836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.142950 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.143149 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.143260 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.143459 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.143650 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.143824 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.143982 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.144165 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.144326 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.144508 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.144667 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.144854 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.145001 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.145144 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.145295 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.145528 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.145685 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.145838 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.146002 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.146164 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.146316 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.146475 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.146629 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852369-2-iscsi {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.146783 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.146936 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.147086 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.147288 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.147458 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.147611 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.147755 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.147946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.148103 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.148247 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.148399 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.149130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.149283 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.149438 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.149593 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.149593 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.149879 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.150082 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.150246 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.150399 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.150552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.150710 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.150855 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.150997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.151160 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.151311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.151468 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.151620 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.151771 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.151922 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.152073 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.152229 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.154084 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.154263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.154422 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.154578 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.154724 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.154888 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.155045 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.155191 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852369-2-iscsi {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.155336 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.155480 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.155630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.155785 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.155936 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.156089 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.156240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.156393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.156548 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.156712 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.156857 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.157000 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.157151 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.157357 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.157527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.157674 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.158084 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.158243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.158399 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.159086 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.159259 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.159413 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.159579 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.159732 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.159892 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.160047 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.160192 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.160343 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.160497 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.160651 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.160796 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.160949 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.161101 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.161245 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.161394 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.161558 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.161714 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.161873 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.162037 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.162199 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.162351 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.162503 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.162655 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.162809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.163529 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.163771 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.163931 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.164836 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.165630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.165790 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.165945 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.166141 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.166290 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.166434 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.166596 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.166749 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.166895 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.167046 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.167189 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.167404 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.167557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.167719 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.167865 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.168015 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.168167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.168321 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.168465 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.168607 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.168750 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.168903 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.169047 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.169199 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.169368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.169368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.169652 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.169803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.169803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.170125 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.170280 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.170423 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.170566 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.170707 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.170850 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.171007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.171169 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.171169 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.171440 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.171440 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.171728 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.171880 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.172030 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.172030 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.172310 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.172454 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.172610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.172766 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.172917 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.173101 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.173800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.174055 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.174247 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.174497 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.174647 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.174799 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.174943 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.175086 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.175246 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.175390 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.175541 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.175686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.175848 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.176003 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.176155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.176299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.176442 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.176585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.176737 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.176900 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.177054 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.177274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.177469 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.177624 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.177788 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.177933 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.178116 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.178263 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.178407 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.178652 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.178812 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.178812 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.179094 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.179247 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.179392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.179535 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.179686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.179880 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.180035 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.180179 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.180323 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.180467 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.180609 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.180752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.180904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.181056 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.181200 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.181343 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.181499 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.181653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.181821 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.181966 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.182149 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.182303 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.182457 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.182457 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.182750 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.182894 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.183044 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.183188 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.183776 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.184030 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.184259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.184428 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.184587 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.184841 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.185000 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.185145 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.185305 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.185305 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.185596 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.185742 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.185885 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.186073 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.186234 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.186393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.186556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.186700 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.186851 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.186995 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.187148 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.187306 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.187451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.187645 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.187805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.187962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.188116 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.188276 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.188421 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.188575 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.188719 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.188873 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.189016 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.189170 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.189322 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.189466 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.189624 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.189778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.189924 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.190118 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.190265 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.190426 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.190426 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.190708 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.190860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.191013 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.191165 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.191316 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.191316 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.191589 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.191589 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.192459 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.192459 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.192766 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.192920 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.193073 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 11:03:54.193217 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.193368 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.194449 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.194607 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.194762 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.195033 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.195188 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.195368 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.195533 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.195702 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.195859 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.196011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.196157 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.196300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.196458 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.196610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.196754 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.196904 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.197056 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.197209 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.197368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.197513 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.197724 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.197877 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.198050 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.198220 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.198368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.199231 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.199397 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.199551 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.199696 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.199851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.200004 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.200235 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.200427 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.200578 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.200723 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.200877 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.201031 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.201175 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.201326 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.201472 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.201623 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.201778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.201932 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.202113 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.202268 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.202431 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.202587 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.202740 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.202892 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.203036 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.203188 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.203331 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.203489 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.203647 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.203799 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.204554 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.204937 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.205247 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.205526 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.205680 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.205832 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.206059 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.206225 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.206379 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.206538 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.206538 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.206835 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.206997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.207152 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.207312 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.207466 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.207629 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.207812 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.207958 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.208101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.208254 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.208398 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.208549 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.208700 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.208853 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.208997 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.209229 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.209383 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.209535 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.209698 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.209844 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.210014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.210179 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.210324 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.210466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.210739 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.210905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.211597 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.211756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.212013 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.212013 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.212310 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.212454 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.212612 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.212757 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.212909 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.213055 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.213206 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.213349 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.213502 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.213657 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.213810 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.213953 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.214648 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.214824 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.214983 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.214983 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.214983 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.214983 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.215757 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.215915 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.216074 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.216220 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.216363 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.216506 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.216657 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.216815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.216975 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.217127 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.217281 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.217432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.217584 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.217736 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.217889 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.218061 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.218213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.218372 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.218518 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.218671 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.218815 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.218976 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.219121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.219272 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.219425 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.219577 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.219721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.219721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.220009 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.220153 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.220312 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.220468 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.220612 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.220764 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.220908 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.221052 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.221208 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.221354 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.221354 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.221641 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.221793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.222108 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.222274 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.222420 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.222571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.222724 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.222887 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.223040 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.223183 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.223326 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.223486 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.223651 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.223806 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.223957 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.224102 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.224505 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.224888 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.225048 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.225048 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.225359 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.225605 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.225782 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.226030 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.226202 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.226347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.226499 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.227252 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.227445 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.227608 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.227755 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.227900 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.228064 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.228217 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.228369 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.228523 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.228670 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.228813 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.228964 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.229109 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.229253 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.229406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.229550 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.229694 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.229854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.230068 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.230237 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.230400 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.230560 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.230711 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.230869 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.231021 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.231180 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.231332 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.231482 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.231632 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.231783 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.231933 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.232109 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.232270 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.232422 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.232572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.233343 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.233514 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.233693 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.233853 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.234038 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.234197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.234348 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.235023 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.235213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.235484 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.235768 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.235933 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.236199 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.236369 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.236523 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.236688 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.236840 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.236990 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.237149 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.237312 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.237464 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.237622 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.237801 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.237953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.238144 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.238313 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.238465 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.238615 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.238764 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.238923 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.239074 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.239235 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.239386 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.239574 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.239746 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.239905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.240066 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.240227 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.240524 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.241005 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.241200 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.241357 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.241520 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.241680 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.241831 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.242001 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.242001 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.242437 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.242725 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.242884 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.243045 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.243206 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.243359 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.243527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.243692 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.243855 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.244015 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.244183 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.245379 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.245573 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.245768 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.246095 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.246268 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.246527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.246687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.246854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.247014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.247166 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.247316 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.247475 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.247629 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.247789 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.247989 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.248157 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.248317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.248469 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.248629 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.248790 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.248950 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.249102 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.249252 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.249410 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.249642 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.249797 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.249955 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.250183 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.250338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.250489 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.250650 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.250812 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.250972 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.251124 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.251274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.251433 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.251604 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.251757 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.251908 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.252067 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.252229 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.252391 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.252542 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.252700 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.252853 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.253013 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.253178 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.253340 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.253504 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.253662 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.253821 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.254020 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.254180 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.254356 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.254507 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.254657 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.255289 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.255460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.255613 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.255779 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.255932 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.256186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.256344 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.256524 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.256777 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.256942 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.257106 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.257259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.257417 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.257569 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.257800 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.258559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.258796 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.259004 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.259191 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.259344 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.259505 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.259666 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.259825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.259998 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.260151 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.260302 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.260462 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.260614 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.260779 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.260931 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.261090 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.261250 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.261410 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.261570 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.261728 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.261880 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.262089 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.262261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.262413 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.262565 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.262723 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.262881 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.263039 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.263200 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.263352 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.263512 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.263662 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.263822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.263992 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.264162 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.264324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.264484 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.264643 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.265401 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.265568 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.265732 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.265893 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.266068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.266322 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.266513 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.266960 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.267144 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.267304 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.267458 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.267608 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.267767 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.267933 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.268094 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.268254 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.268414 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.268574 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.268574 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.268881 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.269039 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.269208 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.269368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.269520 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.269671 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.269830 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.270026 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.270026 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.270335 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.270500 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.270664 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.270664 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.270962 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.271132 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.271298 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.271459 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.271611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.271763 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.271914 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.272073 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.272234 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.272394 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.272545 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.272697 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.272856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.273020 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.273187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.273339 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.273546 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.274212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.274373 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.274544 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.274737 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.274903 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.275084 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.275699 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.275872 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.276040 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.276193 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.276374 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.276627 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.276792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.276972 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.277226 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.277390 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.277549 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.277708 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.277869 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.278093 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.278301 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.278460 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.278612 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.278783 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.278935 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.279100 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.279259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.279410 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.279567 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.279830 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.280006 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.280172 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.280325 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.280476 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.280627 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.280788 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.280948 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.281116 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.281276 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.281426 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.281576 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.281725 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.281885 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.282058 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.282216 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.282397 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.283046 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.283210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.283384 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.283545 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.283698 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.283849 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.284000 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.284166 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.284335 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.284496 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.284647 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.284797 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.284956 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.285178 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.285360 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.286032 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.286207 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.286362 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.286514 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.286680 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.286851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.287090 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.287271 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.287510 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.287676 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.287676 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.287982 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.288145 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.288296 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.288448 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.288599 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.288765 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.288924 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.289091 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.289814 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.289999 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.290161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.290326 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.290478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.290631 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.290802 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.290954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.291192 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.291346 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.291496 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.291656 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.291808 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.291967 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.292127 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.292279 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.292429 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.292587 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.292749 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.292919 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.293080 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.293233 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.293383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.293541 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.293702 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.293853 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.294049 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.294224 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.294224 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.294522 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.294682 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.294850 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.295031 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.295031 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.295339 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.295519 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.296134 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.296306 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.296466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.296626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.296778 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.296932 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.297111 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.297362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.297539 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.297797 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.297964 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.298155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.298317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.298486 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.298645 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.298806 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.298966 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.299119 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.299420 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.299614 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.299770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.299941 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.300102 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.300254 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.300415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.300586 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.300746 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.300897 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.301056 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.301209 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.301418 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.301580 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.301731 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.301891 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.302136 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.302293 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.302459 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.302619 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.302770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.302930 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.303082 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.303248 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.303401 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.303551 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.303701 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.303851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.304002 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.304186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.304349 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.304502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.304652 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.305419 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.305658 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.306233 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.306398 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.306551 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.306712 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.306879 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.307031 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.307190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.307374 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.307624 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.307801 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.308057 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.308224 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.308387 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.308537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.308697 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.308848 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.309008 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.309168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.309327 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.309492 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.309643 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.309808 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.309968 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.310166 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.310328 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.310480 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.310639 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.310838 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.310995 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.311146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.311296 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.311447 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.311610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.311776 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.311936 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.312087 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.312245 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.312396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.312396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.312707 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.312859 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.313088 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.313246 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.313415 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.313575 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.313753 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.313905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.314105 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.314259 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.314421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.314421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.314728 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.314889 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.315040 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.315191 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.315342 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.315576 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.315731 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.315893 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.316270 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.316439 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.316599 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.316763 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.316959 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.317121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.317281 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.317441 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.317621 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.317873 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.318079 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.318249 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.318410 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.318562 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.318727 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.318887 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.319058 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.319800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.319974 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.320136 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.320303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.320492 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.320777 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.320944 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.321104 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.321256 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.321417 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.321570 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.321721 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.321871 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.322081 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.322257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.322418 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.322571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.322730 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.322901 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.323053 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.323214 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.323365 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.323516 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.323712 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.323879 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.324040 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.324193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.324343 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.324504 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.324656 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.324814 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.324989 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.325151 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.325315 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.325467 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.325617 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.325767 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.325932 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.326363 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.326526 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.326687 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.326891 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.326891 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.327206 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.327369 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.327521 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.327671 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.327854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.328122 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.328289 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.328443 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.328594 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.328594 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.328897 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.329064 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.329223 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.329223 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.329535 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.329685 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.329845 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.330038 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.330198 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.330357 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.330509 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.330668 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.330830 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.330992 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.331143 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.331300 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.331471 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.331623 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.331783 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.331934 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.332095 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.332255 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.332414 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.332572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.332733 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.332885 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.333042 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.333229 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.333394 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.333559 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.333724 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.333883 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.334084 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.334242 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.334409 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.334409 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.334715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.334867 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.335017 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.335175 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.335328 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.335503 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.335656 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.335814 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.335993 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.336160 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.336524 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.336700 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.336860 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.337019 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.337170 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.337329 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.337481 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.337647 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.337819 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.338005 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.338282 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.338450 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.338612 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.338766 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.338926 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.339086 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.339246 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.339398 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.339562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.339723 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.339884 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.340055 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.340207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.340422 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.340588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.340741 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.340900 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.341059 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.341379 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.341549 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.341711 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.341863 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.342060 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.342239 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.342399 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.342600 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.342758 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.342919 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.343080 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.343232 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.343391 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.343558 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.343709 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.343860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.344012 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.344163 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.344340 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.344518 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.344671 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.344671 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.344974 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.345125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.345275 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.345476 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.345641 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.345793 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.345959 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.346142 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.346311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.346311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.346772 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.346926 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.347077 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.347077 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.347460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.347623 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.347782 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.347782 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.348096 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.348269 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.348521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.348686 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.348850 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.349009 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.349202 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.349371 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.349538 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.349698 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.349850 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.350026 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.350196 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.350359 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.350359 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.350661 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.350835 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.350987 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.351137 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.351302 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.351463 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.352150 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.352331 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.352485 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.352644 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.352807 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.352970 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.353130 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.353281 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.353457 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.353618 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.353781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.353933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.354146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.354311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.354473 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.354642 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.354793 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.354944 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.355103 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.355255 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.355406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.355578 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.355731 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.355889 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.356048 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.356246 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.356411 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.356719 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.356891 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.357044 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.357204 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.357356 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.357506 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.357683 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.357835 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.358018 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.358189 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.358363 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.358549 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.358549 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.358850 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.359000 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.359159 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.359311 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.359476 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.359635 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.359806 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.359958 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.360109 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.360269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.360435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.360587 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.360738 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.360897 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.361049 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.361213 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.361372 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.361524 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.361697 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.361858 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.362062 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.362232 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.362394 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.362553 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.362704 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.362862 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.363015 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.363180 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.363341 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.363500 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.363651 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.363812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.363975 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.364126 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.364277 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.364434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.364598 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.364779 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.365379 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.365543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.365946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.366136 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.366312 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.366475 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.366627 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.366925 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.367080 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.367796 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.368011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.368179 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.368404 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.368564 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.368717 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.368877 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.369037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.369212 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.369365 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.369524 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.369676 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.369827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.370029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.370192 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.370345 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.370508 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.370660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.370819 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.370980 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.371143 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.371303 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.371470 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.371621 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.371781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.371947 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.372098 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.372250 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.372402 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.372561 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.372713 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.372879 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.373031 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.373031 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.373330 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.373482 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.373642 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.373794 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.373952 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.374145 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.374306 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.374465 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.374465 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.374781 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.374932 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.375101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.375261 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.375412 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.375573 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.375733 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.375891 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.376053 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.376205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.376356 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.376521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.376674 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.376966 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.377133 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.377303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.377466 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.377626 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.377787 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.377946 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.378171 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.378333 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.378499 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.378660 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.378811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.378962 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.379122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.379273 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.379273 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.379656 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.379815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.379974 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.380125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.380275 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.380440 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.380600 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.380759 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.380911 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.381061 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.381221 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.381373 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.381534 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.381685 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.381836 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.382031 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.382205 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.382357 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.382508 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.382666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.382854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.383040 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.383256 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.383412 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.383574 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.383734 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.383886 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.384046 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.384198 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.384348 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.384512 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.384671 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.384830 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.384998 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.385151 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.385302 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.385460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.385630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.385791 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.385957 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.386166 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.386319 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.386479 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.386638 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.386788 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.387087 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.387258 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.387420 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.387579 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.387742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.387909 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.387909 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.388216 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.388367 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.388526 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.388692 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.388857 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.389016 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.389169 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.389320 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.389470 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.389649 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.390390 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.390562 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.390716 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.390877 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.391040 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.391204 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.391356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.391507 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.391666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.391827 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.391987 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.392159 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.392313 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.392476 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.392627 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.392778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.392928 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.393089 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.393249 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.393403 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.393561 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.393712 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.393863 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 11:03:54.394057 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.394057 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.394057 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.394057 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.394057 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.394057 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.394057 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.394057 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.395234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.395234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.395234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.395234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.395234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.395234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.395234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.395234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.396372 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.396372 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.396372 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.396372 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.396372 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.396372 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.396372 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.396372 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.397603 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.397603 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.397603 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.397603 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.397603 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.397603 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.397603 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.397603 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.398844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.398844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.398844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.398844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.398844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.398844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.398844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.398844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.400094 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.400094 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.400094 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.400094 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.400094 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.400094 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.400094 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.400094 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.401274 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.401274 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.401274 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.401274 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.401274 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.401274 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.401274 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.401274 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.402502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.402502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.402502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.402502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.402502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.402502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.402502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.402502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.403672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.403672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.403672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.403672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.403672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.403672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.403672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.403672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.404837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.404837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.404837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.404837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.404837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.404837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.404837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.404837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.406065 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.406065 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.406065 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.406065 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.406065 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.406065 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.406065 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.406065 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.407235 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.407235 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.407235 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.407235 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.407235 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.407235 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.407235 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.407235 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.408391 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.408391 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.408391 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.408391 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.408391 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.408391 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.408391 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.408391 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.409614 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.409614 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.409614 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.409614 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.409614 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.409614 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.409614 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.409614 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.410792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.410792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.410792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.410792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.410792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.410792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.410792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.410792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.411960 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.411960 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.411960 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.411960 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.411960 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.411960 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.411960 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.411960 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.413117 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 11:03:54.413117 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 11:03:54.426316 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO dbcounter [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] Registered counter for database nova_api Aug 26 11:03:54.446868 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_db.sqlalchemy.engines [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 11:03:54.453466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writer thread running {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 11:03:54.468426 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO dbcounter [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] Registered counter for database nova_api Aug 26 11:03:54.489004 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_db.sqlalchemy.engines [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 11:03:54.496421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writer thread running {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 11:03:54.510124 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.context [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),51910246-b507-43fe-b5f6-535f38f61839(cell1) {{(pid=120604) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 11:03:54.514190 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:03:54.514664 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:03:54.516236 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:03:54.516956 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:03:54.517407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:03:54.519410 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:03:54.521392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO dbcounter [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] Registered counter for database nova_cell0 Aug 26 11:03:54.525503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO dbcounter [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] Registered counter for database nova_cell1 Aug 26 11:03:54.532736 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_db.sqlalchemy.engines [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 11:03:54.535066 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_db.sqlalchemy.engines [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 11:03:54.540355 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writer thread running {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 11:03:54.543606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writer thread running {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 11:03:54.552969 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.context [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),51910246-b507-43fe-b5f6-535f38f61839(cell1) {{(pid=120605) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 11:03:54.557579 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:03:54.558152 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:03:54.559741 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:03:54.560464 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:03:54.560917 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:03:54.562942 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:03:54.564949 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO dbcounter [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] Registered counter for database nova_cell0 Aug 26 11:03:54.568975 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO dbcounter [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] Registered counter for database nova_cell1 Aug 26 11:03:54.576241 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_db.sqlalchemy.engines [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 11:03:54.577875 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_db.sqlalchemy.engines [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 11:03:54.583791 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writer thread running {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 11:03:54.585859 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writer thread running {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 11:03:54.695156 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO dbcounter [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] Registered counter for database nova_cell0 Aug 26 11:03:54.702116 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_db.sqlalchemy.engines [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 11:03:54.706632 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writer thread running {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 11:03:54.735901 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO dbcounter [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] Registered counter for database nova_cell0 Aug 26 11:03:54.743174 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_db.sqlalchemy.engines [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 11:03:54.747784 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writer thread running {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 11:03:55.033960 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: WARNING keystonemiddleware.auth_token [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 11:03:55.041199 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: WARNING keystonemiddleware.auth_token [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 11:03:55.072534 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: WARNING keystonemiddleware.auth_token [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 11:03:55.079910 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: WARNING keystonemiddleware.auth_token [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 11:03:55.391964 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: WARNING keystonemiddleware.auth_token [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 11:03:55.398081 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: WARNING keystonemiddleware.auth_token [None req-b662f374-859d-4ef2-9a86-33b9efa3f49b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 11:03:55.403955 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5620edc839c0 pid: 120604 (default app) Aug 26 11:03:55.433562 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: WARNING keystonemiddleware.auth_token [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 11:03:55.439628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: WARNING keystonemiddleware.auth_token [None req-6d853828-f93d-4245-b933-0ddf80a9b001 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 11:03:55.444932 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5620edc839c0 pid: 120605 (default app) Aug 26 11:04:30.023924 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:04:30.024795 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:04:30.025526 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:04:30.026471 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:04:31.104064 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4a3b68af-74dd-4c37-9804-ecaf919c972b tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] Action: 'create', calling method: .version_select at 0x7f1a69a139d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-260660441", "metadata": {"Type": "work"}}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:04:31.625726 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=3 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:04:31.626877 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=3 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:04:31.627624 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=3 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:04:31.628349 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=3 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:04:32.900267 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-991329f6-f0d9-47f1-a348-70fe33c4b764 tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Action: 'create', calling method: .version_select at 0x7f1a69a129d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-545094923", "metadata": {"Type": "work"}}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-991329f6-f0d9-47f1-a348-70fe33c4b764 tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Request method failure captured: Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 121 Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKi_wIatgK809SoF254AR_A9gEdUW0nvJdbBHqptlfwsKsPmdK-uoeChp7aUVluBlN075PUtYtrFrjppEsfXuck0vexrknC_6sBFAH5ZP6L2qwq0xBiZwhzg_XTHBweYqG1uQEiDmfxobon5ayKSvsgYggFP8aY_15q2Dnr8EcD6smQ Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: c6a71f4243b14f2aa2fe5c8b8e3741e1 Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:04:32.910532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:04:32.912263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}] Aug 26 11:04:32.912263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:32.912263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: c6a71f4243b14f2aa2fe5c8b8e3741e1 Aug 26 11:04:32.912263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:32.912263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-VolumesNegativeTest-473386313-project Aug 26 11:04:32.912263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:04:32.912263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:04:32.912263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: e3201429fd7242d39007fb286cade424 Aug 26 11:04:32.912263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-VolumesNegativeTest-473386313-project Aug 26 11:04:32.912263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Aug 26 11:04:32.912263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-545094923", "metadata": {"Type": "work"}}} Aug 26 11:04:32.912263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: Aug 26 11:04:32.912263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-545094923', 'metadata': {'Type': 'work'}}}} Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise error Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi '#$%' Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:04:32.913861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 11:04:32.915822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 11:04:32.917279 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 11:04:32.917279 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:32.917279 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-991329f6-f0d9-47f1-a348-70fe33c4b764 tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:04:32.917279 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-991329f6-f0d9-47f1-a348-70fe33c4b764 tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.291808 Aug 26 11:04:32.918984 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Aug 26 11:04:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1300 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 26 11:04:33.223715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4a3b68af-74dd-4c37-9804-ecaf919c972b tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.217417 Aug 26 11:04:33.226458 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 1/2] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Aug 26 11:04:30 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3222 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 26 11:04:33.240272 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-cdc65c96-844c-4fb1-8b24-0c567ba5cf4b tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Action: 'create', calling method: .version_select at 0x7f1a698e8790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-258604461", "metadata": {"Type": "work"}}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-cdc65c96-844c-4fb1-8b24-0c567ba5cf4b tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Request method failure captured: Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 119 Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKi_wIatgK809SoF254AR_A9gEdUW0nvJdbBHqptlfwsKsPmdK-uoeChp7aUVluBlN075PUtYtrFrjppEsfXuck0vexrknC_6sBFAH5ZP6L2qwq0xBiZwhzg_XTHBweYqG1uQEiDmfxobon5ayKSvsgYggFP8aY_15q2Dnr8EcD6smQ Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: c6a71f4243b14f2aa2fe5c8b8e3741e1 Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:04:33.261095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:04:33.262432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}] Aug 26 11:04:33.262432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:33.262432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: c6a71f4243b14f2aa2fe5c8b8e3741e1 Aug 26 11:04:33.262432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:33.262432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-VolumesNegativeTest-473386313-project Aug 26 11:04:33.262432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:04:33.262432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:04:33.262432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: e3201429fd7242d39007fb286cade424 Aug 26 11:04:33.262432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-VolumesNegativeTest-473386313-project Aug 26 11:04:33.262432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Aug 26 11:04:33.262432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-258604461", "metadata": {"Type": "work"}}} Aug 26 11:04:33.262432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: Aug 26 11:04:33.262432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-258604461', 'metadata': {'Type': 'work'}}}} Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise error Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi '0' Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:04:33.263299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 11:04:33.264556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 11:04:33.265660 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 11:04:33.265660 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.265660 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-cdc65c96-844c-4fb1-8b24-0c567ba5cf4b tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:04:33.265851 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-cdc65c96-844c-4fb1-8b24-0c567ba5cf4b tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.034555 Aug 26 11:04:33.273019 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 2/3] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Aug 26 11:04:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 11:04:33.288233 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7b4efbf4-25a2-4f07-9674-4fc1937c04a5 tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] Calling method '.version_select at 0x7f1a698be1f0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:33.417468 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7b4efbf4-25a2-4f07-9674-4fc1937c04a5 tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/94ef145a-9d5a-4ada-ae7d-f02a862d13d2" status: 200 len: 352 microversion: 2.1 time: 0.142291 Aug 26 11:04:33.418284 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 3/4] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 11:04:33 2022] GET /compute/v2.1/os-volumes/94ef145a-9d5a-4ada-ae7d-f02a862d13d2 => generated 352 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:04:33.430826 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a2cc4133-c39b-4f0d-8b5c-4d8011fc77ec tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Action: 'create', calling method: .version_select at 0x7f1a698ffd30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2052170681", "metadata": {"Type": "work"}}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:04:33.434788 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-ad9cbffc-5d6e-4699-a75f-531b0c1d2788 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Action: 'create', calling method: .version_select at 0x7f1a69a12a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1159308973"}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a2cc4133-c39b-4f0d-8b5c-4d8011fc77ec tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Request method failure captured: Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 119 Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKi_wIatgK809SoF254AR_A9gEdUW0nvJdbBHqptlfwsKsPmdK-uoeChp7aUVluBlN075PUtYtrFrjppEsfXuck0vexrknC_6sBFAH5ZP6L2qwq0xBiZwhzg_XTHBweYqG1uQEiDmfxobon5ayKSvsgYggFP8aY_15q2Dnr8EcD6smQ Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: c6a71f4243b14f2aa2fe5c8b8e3741e1 Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:04:33.441557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:04:33.443666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}] Aug 26 11:04:33.443666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:33.443666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: c6a71f4243b14f2aa2fe5c8b8e3741e1 Aug 26 11:04:33.443666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:33.443666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-VolumesNegativeTest-473386313-project Aug 26 11:04:33.443666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:04:33.443666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:04:33.443666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: e3201429fd7242d39007fb286cade424 Aug 26 11:04:33.443666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-VolumesNegativeTest-473386313-project Aug 26 11:04:33.443666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Aug 26 11:04:33.443666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2052170681", "metadata": {"Type": "work"}}} Aug 26 11:04:33.443666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: Aug 26 11:04:33.443666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2052170681', 'metadata': {'Type': 'work'}}}} Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise error Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi '' Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:04:33.445317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 11:04:33.446756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 11:04:33.448107 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 11:04:33.448107 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.449799 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a2cc4133-c39b-4f0d-8b5c-4d8011fc77ec tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:04:33.453059 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a2cc4133-c39b-4f0d-8b5c-4d8011fc77ec tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027609 Aug 26 11:04:33.454056 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 4/5] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Aug 26 11:04:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 11:04:33.468686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-be920bdd-e3e9-4e55-9786-9dd2776b4d57 tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Calling method '.version_select at 0x7f1a698be4c0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:33.526720 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-be920bdd-e3e9-4e55-9786-9dd2776b4d57 tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] HTTP exception thrown: Volume tempest-invalid-1021801536 could not be found. Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-be920bdd-e3e9-4e55-9786-9dd2776b4d57 tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Request method failure captured: Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1021801536 HTTP/1.1 Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKi_wIatgK809SoF254AR_A9gEdUW0nvJdbBHqptlfwsKsPmdK-uoeChp7aUVluBlN075PUtYtrFrjppEsfXuck0vexrknC_6sBFAH5ZP6L2qwq0xBiZwhzg_XTHBweYqG1uQEiDmfxobon5ayKSvsgYggFP8aY_15q2Dnr8EcD6smQ Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: c6a71f4243b14f2aa2fe5c8b8e3741e1 Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:04:33.533396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:04:33.535938 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}] Aug 26 11:04:33.535938 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:33.535938 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: c6a71f4243b14f2aa2fe5c8b8e3741e1 Aug 26 11:04:33.535938 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:33.535938 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-VolumesNegativeTest-473386313-project Aug 26 11:04:33.535938 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:04:33.535938 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:04:33.535938 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: e3201429fd7242d39007fb286cade424 Aug 26 11:04:33.535938 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-VolumesNegativeTest-473386313-project Aug 26 11:04:33.535938 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: Aug 26 11:04:33.535938 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Volume tempest-invalid-1021801536 could not be found. Aug 26 11:04:33.535938 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'tempest-invalid-1021801536'} Aug 26 11:04:33.535938 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1021801536 could not be found. (HTTP 404) (Request-ID: req-183604d3-9644-4aa8-9f79-72da9122bb89) Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:33.536940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 11:04:33.539818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1021801536 could not be found. Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:04:33.541704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1021801536 could not be found. Aug 26 11:04:33.544753 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.544753 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:33.544753 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.544753 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:33.544753 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:33.544753 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:33.544753 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:04:33.544753 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:04:33.544753 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1021801536 could not be found. Aug 26 11:04:33.544753 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.547203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-be920bdd-e3e9-4e55-9786-9dd2776b4d57 tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Returning 404 to user: Volume tempest-invalid-1021801536 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:04:33.548185 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-be920bdd-e3e9-4e55-9786-9dd2776b4d57 tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1021801536" status: 404 len: 99 microversion: 2.1 time: 0.088062 Aug 26 11:04:33.549700 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 5/6] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 26 11:04:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1021801536 => generated 99 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 26 11:04:33.563776 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3ef47f94-1d98-4107-a7ed-65866884af04 tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007652 Aug 26 11:04:33.567810 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 6/7] 10.222.0.40 () {58 vars in 1140 bytes} [Fri Aug 26 11:04:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 26 11:04:33.584470 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-66c6d67d-93f6-4ee9-a9ab-db5435a33c65 tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012576 Aug 26 11:04:33.586174 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 7/8] 10.222.0.40 () {58 vars in 1137 bytes} [Fri Aug 26 11:04:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 26 11:04:33.599719 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6dc0bd22-1b0d-4471-a9c0-a322d856763f tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Calling method '.version_select at 0x7f1a698be940>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:33.650128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-6dc0bd22-1b0d-4471-a9c0-a322d856763f tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] HTTP exception thrown: Volume 746fa2e7-8d3b-43d4-949f-1f7bfa1f0e3e could not be found. Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6dc0bd22-1b0d-4471-a9c0-a322d856763f tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Request method failure captured: Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: DELETE /compute/v2.1/os-volumes/746fa2e7-8d3b-43d4-949f-1f7bfa1f0e3e HTTP/1.1 Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKi_wIatgK809SoF254AR_A9gEdUW0nvJdbBHqptlfwsKsPmdK-uoeChp7aUVluBlN075PUtYtrFrjppEsfXuck0vexrknC_6sBFAH5ZP6L2qwq0xBiZwhzg_XTHBweYqG1uQEiDmfxobon5ayKSvsgYggFP8aY_15q2Dnr8EcD6smQ Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: c6a71f4243b14f2aa2fe5c8b8e3741e1 Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:04:33.652540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:04:33.653806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}] Aug 26 11:04:33.653806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:33.653806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: c6a71f4243b14f2aa2fe5c8b8e3741e1 Aug 26 11:04:33.653806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:33.653806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-VolumesNegativeTest-473386313-project Aug 26 11:04:33.653806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:04:33.653806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:04:33.653806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: e3201429fd7242d39007fb286cade424 Aug 26 11:04:33.653806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-VolumesNegativeTest-473386313-project Aug 26 11:04:33.653806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: Aug 26 11:04:33.653806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Volume 746fa2e7-8d3b-43d4-949f-1f7bfa1f0e3e could not be found. Aug 26 11:04:33.653806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': '746fa2e7-8d3b-43d4-949f-1f7bfa1f0e3e'} Aug 26 11:04:33.653806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 746fa2e7-8d3b-43d4-949f-1f7bfa1f0e3e could not be found. (HTTP 404) (Request-ID: req-e1180698-cf34-4735-857b-2d5151f0e4da) Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:33.654631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 11:04:33.655803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 746fa2e7-8d3b-43d4-949f-1f7bfa1f0e3e could not be found. Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 11:04:33.656871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:04:33.658409 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 746fa2e7-8d3b-43d4-949f-1f7bfa1f0e3e could not be found. Aug 26 11:04:33.658409 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.658409 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:33.658409 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.658409 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:33.658409 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:33.658409 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:33.658409 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:04:33.658409 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:04:33.658409 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 746fa2e7-8d3b-43d4-949f-1f7bfa1f0e3e could not be found. Aug 26 11:04:33.658409 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:33.660289 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6dc0bd22-1b0d-4471-a9c0-a322d856763f tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Returning 404 to user: Volume 746fa2e7-8d3b-43d4-949f-1f7bfa1f0e3e could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:04:33.661159 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6dc0bd22-1b0d-4471-a9c0-a322d856763f tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/746fa2e7-8d3b-43d4-949f-1f7bfa1f0e3e" status: 404 len: 109 microversion: 2.1 time: 0.070209 Aug 26 11:04:33.662177 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 8/9] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 11:04:33 2022] DELETE /compute/v2.1/os-volumes/746fa2e7-8d3b-43d4-949f-1f7bfa1f0e3e => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:04:33.674259 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-dec44d15-9f56-4b88-b8c7-3f3a0a4a6136 tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Calling method '.version_select at 0x7f1a698be5e0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:34.127434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-dec44d15-9f56-4b88-b8c7-3f3a0a4a6136 tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] HTTP exception thrown: Volume ca851f18-c03a-4919-8a54-89815f014f7f could not be found. Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-dec44d15-9f56-4b88-b8c7-3f3a0a4a6136 tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Request method failure captured: Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/os-volumes/ca851f18-c03a-4919-8a54-89815f014f7f HTTP/1.1 Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKi_wIatgK809SoF254AR_A9gEdUW0nvJdbBHqptlfwsKsPmdK-uoeChp7aUVluBlN075PUtYtrFrjppEsfXuck0vexrknC_6sBFAH5ZP6L2qwq0xBiZwhzg_XTHBweYqG1uQEiDmfxobon5ayKSvsgYggFP8aY_15q2Dnr8EcD6smQ Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: c6a71f4243b14f2aa2fe5c8b8e3741e1 Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:04:34.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:04:34.130798 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c6a71f4243b14f2aa2fe5c8b8e3741e1"}]}] Aug 26 11:04:34.130798 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:34.130798 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: c6a71f4243b14f2aa2fe5c8b8e3741e1 Aug 26 11:04:34.130798 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-VolumesNegativeTest-473386313 Aug 26 11:04:34.130798 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-VolumesNegativeTest-473386313-project Aug 26 11:04:34.130798 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:04:34.130798 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:04:34.130798 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: e3201429fd7242d39007fb286cade424 Aug 26 11:04:34.130798 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-VolumesNegativeTest-473386313-project Aug 26 11:04:34.130798 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: Aug 26 11:04:34.130798 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Volume ca851f18-c03a-4919-8a54-89815f014f7f could not be found. Aug 26 11:04:34.130798 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'ca851f18-c03a-4919-8a54-89815f014f7f'} Aug 26 11:04:34.130798 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca851f18-c03a-4919-8a54-89815f014f7f could not be found. (HTTP 404) (Request-ID: req-6f32e07c-6b8b-4a5a-9238-24b4399eba1d) Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:34.131572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 11:04:34.134205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca851f18-c03a-4919-8a54-89815f014f7f could not be found. Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 11:04:34.136327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:04:34.140953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca851f18-c03a-4919-8a54-89815f014f7f could not be found. Aug 26 11:04:34.140953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:34.140953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:34.140953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:34.140953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:34.140953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:34.140953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:34.140953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:04:34.140953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:04:34.140953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca851f18-c03a-4919-8a54-89815f014f7f could not be found. Aug 26 11:04:34.140953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:34.140953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-dec44d15-9f56-4b88-b8c7-3f3a0a4a6136 tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] Returning 404 to user: Volume ca851f18-c03a-4919-8a54-89815f014f7f could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:04:34.140953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-dec44d15-9f56-4b88-b8c7-3f3a0a4a6136 tempest-VolumesNegativeTest-473386313 tempest-VolumesNegativeTest-473386313-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/ca851f18-c03a-4919-8a54-89815f014f7f" status: 404 len: 109 microversion: 2.1 time: 0.471179 Aug 26 11:04:34.143012 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 9/10] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 11:04:33 2022] GET /compute/v2.1/os-volumes/ca851f18-c03a-4919-8a54-89815f014f7f => generated 109 bytes in 475 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:04:34.432212 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-71ced34e-72d9-4a73-9282-39a3017875e0 tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] Calling method '.version_select at 0x7f1a698e8af0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:34.452482 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-ad9cbffc-5d6e-4699-a75f-531b0c1d2788 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.531497 Aug 26 11:04:34.463341 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 2/11] 10.222.0.40 () {60 vars in 1155 bytes} [Fri Aug 26 11:04:32 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1544 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 26 11:04:34.469859 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-d8633651-51ae-4841-8b03-e878a829779a tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a698a9dc0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:34.537465 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-d8633651-51ae-4841-8b03-e878a829779a tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d" status: 200 len: 345 microversion: 2.1 time: 0.072427 Aug 26 11:04:34.539798 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 3/12] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 11:04:34 2022] GET /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d => generated 345 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:04:34.547063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-71ced34e-72d9-4a73-9282-39a3017875e0 tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/94ef145a-9d5a-4ada-ae7d-f02a862d13d2" status: 200 len: 353 microversion: 2.1 time: 0.119632 Aug 26 11:04:34.548156 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 10/13] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 11:04:34 2022] GET /compute/v2.1/os-volumes/94ef145a-9d5a-4ada-ae7d-f02a862d13d2 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:04:34.562485 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-be61750f-f5ff-4987-9485-304e5f52956e tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] Calling method '.version_select at 0x7f1a698b84c0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:34.661332 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-be61750f-f5ff-4987-9485-304e5f52956e tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/94ef145a-9d5a-4ada-ae7d-f02a862d13d2" status: 200 len: 353 microversion: 2.1 time: 0.102699 Aug 26 11:04:34.662649 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 4/14] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 11:04:34 2022] GET /compute/v2.1/os-volumes/94ef145a-9d5a-4ada-ae7d-f02a862d13d2 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:04:34.688232 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e5234c81-0a8c-41fd-a230-0f74eb8d56ae tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] Calling method '.version_select at 0x7f1a698103a0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:34.909124 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e5234c81-0a8c-41fd-a230-0f74eb8d56ae tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/94ef145a-9d5a-4ada-ae7d-f02a862d13d2" status: 202 len: 0 microversion: 2.1 time: 0.228919 Aug 26 11:04:34.910089 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 11/15] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 11:04:34 2022] DELETE /compute/v2.1/os-volumes/94ef145a-9d5a-4ada-ae7d-f02a862d13d2 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:04:34.919263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-823f8f84-2a86-45ba-98ba-4390fcbc3f8c tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] Calling method '.version_select at 0x7f1a698a9ca0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:35.003063 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-823f8f84-2a86-45ba-98ba-4390fcbc3f8c tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/94ef145a-9d5a-4ada-ae7d-f02a862d13d2" status: 200 len: 352 microversion: 2.1 time: 0.088981 Aug 26 11:04:35.005270 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 5/16] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 11:04:34 2022] GET /compute/v2.1/os-volumes/94ef145a-9d5a-4ada-ae7d-f02a862d13d2 => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:04:35.580749 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f5bea034-2ee1-495d-85b8-4204c24323a7 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a698be040>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:35.936464 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f5bea034-2ee1-495d-85b8-4204c24323a7 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d" status: 200 len: 346 microversion: 2.1 time: 0.382804 Aug 26 11:04:35.943222 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 12/17] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 11:04:35 2022] GET /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d => generated 346 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:04:35.957530 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-21cfe7c3-783c-40a3-8b1d-e013b29bcd2b tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Action: 'create', calling method: .version_select at 0x7f1a698b8430>, body: {"snapshot": {"volume_id": "9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-401319092"}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:04:36.020930 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-bc01ac7e-6c27-4c75-b678-0552b958435e tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] Calling method '.version_select at 0x7f1a698be5e0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:36.215493 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-bc01ac7e-6c27-4c75-b678-0552b958435e tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] HTTP exception thrown: Volume 94ef145a-9d5a-4ada-ae7d-f02a862d13d2 could not be found. Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-bc01ac7e-6c27-4c75-b678-0552b958435e tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] Request method failure captured: Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/os-volumes/94ef145a-9d5a-4ada-ae7d-f02a862d13d2 HTTP/1.1 Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKi9u4cEZ9lg5KYpkS3m2fIZqsYAFq-GQHu7XTCpXmpyOn3y30BUK6cEhnb4oc3DH2VoqhFBdak7RCmjYasoqjSnMsicmdt5LQoIFJ2a5IQait72aO3mSykh91fwWCDzCJR2Hs-lrIbGkDk7NYolsdOa1CJWAly8s5_EXWkBSWfoBT0 Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: a3707cc107d343f9a1fd2df1ddc89441 Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-VolumesGetTestJSON-301788899 Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:04:36.217431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:04:36.218562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a3707cc107d343f9a1fd2df1ddc89441"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a3707cc107d343f9a1fd2df1ddc89441"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a3707cc107d343f9a1fd2df1ddc89441"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a3707cc107d343f9a1fd2df1ddc89441"}]}] Aug 26 11:04:36.218562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-VolumesGetTestJSON-301788899 Aug 26 11:04:36.218562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: a3707cc107d343f9a1fd2df1ddc89441 Aug 26 11:04:36.218562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-VolumesGetTestJSON-301788899 Aug 26 11:04:36.218562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-VolumesGetTestJSON-301788899-project Aug 26 11:04:36.218562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:04:36.218562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:04:36.218562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 8df99d3b39454d12a3742b84578dc818 Aug 26 11:04:36.218562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-VolumesGetTestJSON-301788899-project Aug 26 11:04:36.218562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: Aug 26 11:04:36.218562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Volume 94ef145a-9d5a-4ada-ae7d-f02a862d13d2 could not be found. Aug 26 11:04:36.218562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': '94ef145a-9d5a-4ada-ae7d-f02a862d13d2'} Aug 26 11:04:36.218562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94ef145a-9d5a-4ada-ae7d-f02a862d13d2 could not be found. (HTTP 404) (Request-ID: req-79061e4b-8040-4b08-a689-08c9b3d16def) Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:36.219128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 11:04:36.220146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94ef145a-9d5a-4ada-ae7d-f02a862d13d2 could not be found. Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 11:04:36.221161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:04:36.222069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94ef145a-9d5a-4ada-ae7d-f02a862d13d2 could not be found. Aug 26 11:04:36.222069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:36.222069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:36.222069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:36.222069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:36.222069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:36.222069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:36.222069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:04:36.222069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:04:36.222069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94ef145a-9d5a-4ada-ae7d-f02a862d13d2 could not be found. Aug 26 11:04:36.222069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:04:36.222069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-bc01ac7e-6c27-4c75-b678-0552b958435e tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] Returning 404 to user: Volume 94ef145a-9d5a-4ada-ae7d-f02a862d13d2 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:04:36.222069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-bc01ac7e-6c27-4c75-b678-0552b958435e tempest-VolumesGetTestJSON-301788899 tempest-VolumesGetTestJSON-301788899-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/94ef145a-9d5a-4ada-ae7d-f02a862d13d2" status: 404 len: 109 microversion: 2.1 time: 0.202882 Aug 26 11:04:36.222069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 13/18] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 11:04:36 2022] GET /compute/v2.1/os-volumes/94ef145a-9d5a-4ada-ae7d-f02a862d13d2 => generated 109 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:04:36.655843 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-21cfe7c3-783c-40a3-8b1d-e013b29bcd2b tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.702772 Aug 26 11:04:36.656967 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 6/19] 10.222.0.40 () {60 vars in 1162 bytes} [Fri Aug 26 11:04:35 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:04:36.675806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c72376e4-b55e-439f-a837-e1706fdfbc99 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a698e8700>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:36.894820 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c72376e4-b55e-439f-a837-e1706fdfbc99 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c" status: 200 len: 286 microversion: 2.1 time: 0.230322 Aug 26 11:04:36.896253 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 14/20] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 11:04:36 2022] GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c => generated 286 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:04:36.908365 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-cc0d9132-7ac1-447f-ad3f-dc746306616a tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a698c0550>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:37.029735 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-cc0d9132-7ac1-447f-ad3f-dc746306616a tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.123006 Aug 26 11:04:37.040124 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 7/21] 10.222.0.40 () {58 vars in 1140 bytes} [Fri Aug 26 11:04:36 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:04:37.062084 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0502b0e1-0117-45b3-a2e6-e333b68b6afe tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a698bef70>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:37.119174 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0502b0e1-0117-45b3-a2e6-e333b68b6afe tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c" status: 200 len: 286 microversion: 2.1 time: 0.071245 Aug 26 11:04:37.120135 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 15/22] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 11:04:37 2022] GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:04:38.132695 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5a439806-25bf-4163-8290-494b6d58e6af tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a698c0ca0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:38.213296 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5a439806-25bf-4163-8290-494b6d58e6af tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c" status: 200 len: 286 microversion: 2.1 time: 0.085106 Aug 26 11:04:38.214117 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 8/23] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 11:04:38 2022] GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:04:39.227077 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9f4aea31-b344-47c1-bbd6-4583e4879cb1 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a698be670>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:39.297138 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9f4aea31-b344-47c1-bbd6-4583e4879cb1 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c" status: 200 len: 286 microversion: 2.1 time: 0.074789 Aug 26 11:04:39.302161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 16/24] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 11:04:39 2022] GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:04:40.311378 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-dc32a701-3600-405f-ac6f-b83ea8d19c16 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a698c03a0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:40.359449 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-dc32a701-3600-405f-ac6f-b83ea8d19c16 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c" status: 200 len: 287 microversion: 2.1 time: 0.053047 Aug 26 11:04:40.360113 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 9/25] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 11:04:40 2022] GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:04:40.372424 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6cd45bea-7c52-4f5c-85bf-8aec84b0f059 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a69810040>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:40.506688 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6cd45bea-7c52-4f5c-85bf-8aec84b0f059 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c" status: 202 len: 0 microversion: 2.1 time: 0.138909 Aug 26 11:04:40.508726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 17/26] 10.222.0.40 () {58 vars in 1254 bytes} [Fri Aug 26 11:04:40 2022] DELETE /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:04:40.517669 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-d692fd76-3fac-401a-9a6a-2e436e85c509 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a698b8ca0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:40.560599 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-d692fd76-3fac-401a-9a6a-2e436e85c509 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c" status: 200 len: 286 microversion: 2.1 time: 0.046820 Aug 26 11:04:40.565618 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 10/27] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 11:04:40 2022] GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:04:41.573022 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3b36086f-edca-4886-a1e6-b62d23a7ea90 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a69810d30>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:41.637525 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3b36086f-edca-4886-a1e6-b62d23a7ea90 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c" status: 200 len: 286 microversion: 2.1 time: 0.068553 Aug 26 11:04:41.638933 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 18/28] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 11:04:41 2022] GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:04:42.661883 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b276d14a-635a-4f19-a2dc-8b2fbb1c2ce1 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a698c00d0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:42.760736 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b276d14a-635a-4f19-a2dc-8b2fbb1c2ce1 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c" status: 200 len: 286 microversion: 2.1 time: 0.104831 Aug 26 11:04:42.766278 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 11/29] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 11:04:42 2022] GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c => generated 286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:04:43.776212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-14efb793-6929-4b90-a447-572e09dc718c tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a698c0940>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:43.874949 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-14efb793-6929-4b90-a447-572e09dc718c tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] HTTP exception thrown: Snapshot cce8e524-60ee-48a7-9f4e-f3d0d3759e8c could not be found. Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-14efb793-6929-4b90-a447-572e09dc718c tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Request method failure captured: Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c HTTP/1.1 Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKjASnl3ZH9iFv4YPm0mACjUF2Pe7_CJJ_hDt8rxh0WZXINvDdXuFKow_2MjndCn1z8zjVOR3OZgJFo_mg3ap_T9zfUDULIdVLdwLlhKbH7UxUt2JiOKOAZFvSQUtJBT7dVAV2aXtQC1Da58uwDNUM1_5FY7pM2RjqHO4RG82_-l8_0 Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: 41e03cfe608f47beabce918524dfa2b6 Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2083018949 Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:04:43.879774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:04:43.880906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_41e03cfe608f47beabce918524dfa2b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/41e03cfe608f47beabce918524dfa2b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/41e03cfe608f47beabce918524dfa2b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/41e03cfe608f47beabce918524dfa2b6"}]}] Aug 26 11:04:43.880906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2083018949 Aug 26 11:04:43.880906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: 41e03cfe608f47beabce918524dfa2b6 Aug 26 11:04:43.880906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2083018949 Aug 26 11:04:43.880906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-VolumesSnapshotsTestJSON-2083018949-project Aug 26 11:04:43.880906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:04:43.880906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:04:43.880906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: bbeef9cfedfa4bd386617b92ba1dfc90 Aug 26 11:04:43.880906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2083018949-project Aug 26 11:04:43.880906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: Aug 26 11:04:43.880906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Snapshot cce8e524-60ee-48a7-9f4e-f3d0d3759e8c could not be found. Aug 26 11:04:43.880906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': 'cce8e524-60ee-48a7-9f4e-f3d0d3759e8c'} Aug 26 11:04:43.880906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cce8e524-60ee-48a7-9f4e-f3d0d3759e8c could not be found. (HTTP 404) (Request-ID: req-dcfffc1b-919d-4f7d-a246-07e5448fd038) Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:43.881542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 11:04:43.883029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cce8e524-60ee-48a7-9f4e-f3d0d3759e8c could not be found. Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 26 11:04:43.883916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:04:43.884823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cce8e524-60ee-48a7-9f4e-f3d0d3759e8c could not be found. Aug 26 11:04:43.884823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:43.884823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:43.884823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:43.884823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:43.884823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:43.884823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:43.884823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:04:43.884823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:04:43.884823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cce8e524-60ee-48a7-9f4e-f3d0d3759e8c could not be found. Aug 26 11:04:43.884823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:43.884823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-14efb793-6929-4b90-a447-572e09dc718c tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Returning 404 to user: Snapshot cce8e524-60ee-48a7-9f4e-f3d0d3759e8c could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:04:43.884823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-14efb793-6929-4b90-a447-572e09dc718c tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c" status: 404 len: 111 microversion: 2.1 time: 0.110854 Aug 26 11:04:43.885459 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 12/30] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 11:04:43 2022] GET /compute/v2.1/os-snapshots/cce8e524-60ee-48a7-9f4e-f3d0d3759e8c => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:04:43.905725 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-776a3494-2a65-4f47-ae2b-500981b240d6 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a698d13a0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:44.018311 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1403799107", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:04:44.079497 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-776a3494-2a65-4f47-ae2b-500981b240d6 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d" status: 202 len: 0 microversion: 2.1 time: 0.189862 Aug 26 11:04:44.080392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 13/31] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 11:04:43 2022] DELETE /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:04:44.089255 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-21b84572-dc52-41e9-a46b-6ff6efc61bef tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a698c05e0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:44.250320 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-21b84572-dc52-41e9-a46b-6ff6efc61bef tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d" status: 200 len: 345 microversion: 2.1 time: 0.165090 Aug 26 11:04:44.251267 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 14/32] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 11:04:44 2022] GET /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d => generated 345 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:04:44.292976 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] validate_networks() for [('60347e96-6659-4e98-860c-bd915107c9fd', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:04:45.269295 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-33dd6410-581e-4816-ad5a-d3bb03608a61 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a698c0790>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:45.330530 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-33dd6410-581e-4816-ad5a-d3bb03608a61 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] HTTP exception thrown: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-33dd6410-581e-4816-ad5a-d3bb03608a61 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Request method failure captured: Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d HTTP/1.1 Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKjASnl3ZH9iFv4YPm0mACjUF2Pe7_CJJ_hDt8rxh0WZXINvDdXuFKow_2MjndCn1z8zjVOR3OZgJFo_mg3ap_T9zfUDULIdVLdwLlhKbH7UxUt2JiOKOAZFvSQUtJBT7dVAV2aXtQC1Da58uwDNUM1_5FY7pM2RjqHO4RG82_-l8_0 Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: 41e03cfe608f47beabce918524dfa2b6 Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2083018949 Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:04:45.333150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:04:45.334353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_41e03cfe608f47beabce918524dfa2b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/41e03cfe608f47beabce918524dfa2b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/41e03cfe608f47beabce918524dfa2b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/41e03cfe608f47beabce918524dfa2b6"}]}] Aug 26 11:04:45.334353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2083018949 Aug 26 11:04:45.334353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: 41e03cfe608f47beabce918524dfa2b6 Aug 26 11:04:45.334353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2083018949 Aug 26 11:04:45.334353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-VolumesSnapshotsTestJSON-2083018949-project Aug 26 11:04:45.334353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:04:45.334353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:04:45.334353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: bbeef9cfedfa4bd386617b92ba1dfc90 Aug 26 11:04:45.334353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2083018949-project Aug 26 11:04:45.334353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: Aug 26 11:04:45.334353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. Aug 26 11:04:45.334353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': '9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d'} Aug 26 11:04:45.334353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. (HTTP 404) (Request-ID: req-fdcc0100-7df5-41f7-85a7-cfb1cdc22151) Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:45.335752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 11:04:45.336752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 11:04:45.337604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:04:45.339460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. Aug 26 11:04:45.339460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.339460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:45.339460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.339460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:45.339460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:45.339460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:45.339460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:04:45.339460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:04:45.339460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. Aug 26 11:04:45.339460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.339460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-33dd6410-581e-4816-ad5a-d3bb03608a61 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Returning 404 to user: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:04:45.339460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-33dd6410-581e-4816-ad5a-d3bb03608a61 tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d" status: 404 len: 109 microversion: 2.1 time: 0.071604 Aug 26 11:04:45.339460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 15/33] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 11:04:45 2022] GET /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:04:45.356114 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-dc1a786e-5593-41b4-b89e-68b52389a24f tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a698c0f70>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:45.442996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-dc1a786e-5593-41b4-b89e-68b52389a24f tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] HTTP exception thrown: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-dc1a786e-5593-41b4-b89e-68b52389a24f tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Request method failure captured: Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: DELETE /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d HTTP/1.1 Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKjASnl3ZH9iFv4YPm0mACjUF2Pe7_CJJ_hDt8rxh0WZXINvDdXuFKow_2MjndCn1z8zjVOR3OZgJFo_mg3ap_T9zfUDULIdVLdwLlhKbH7UxUt2JiOKOAZFvSQUtJBT7dVAV2aXtQC1Da58uwDNUM1_5FY7pM2RjqHO4RG82_-l8_0 Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: 41e03cfe608f47beabce918524dfa2b6 Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2083018949 Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:04:45.445058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:04:45.446792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_41e03cfe608f47beabce918524dfa2b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/41e03cfe608f47beabce918524dfa2b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/41e03cfe608f47beabce918524dfa2b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/41e03cfe608f47beabce918524dfa2b6"}]}] Aug 26 11:04:45.446792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2083018949 Aug 26 11:04:45.446792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: 41e03cfe608f47beabce918524dfa2b6 Aug 26 11:04:45.446792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2083018949 Aug 26 11:04:45.446792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-VolumesSnapshotsTestJSON-2083018949-project Aug 26 11:04:45.446792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:04:45.446792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:04:45.446792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: bbeef9cfedfa4bd386617b92ba1dfc90 Aug 26 11:04:45.446792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2083018949-project Aug 26 11:04:45.446792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: Aug 26 11:04:45.446792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. Aug 26 11:04:45.446792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': '9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d'} Aug 26 11:04:45.446792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. (HTTP 404) (Request-ID: req-0311ba51-cd63-4518-a9ca-52e988db5c80) Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:45.447416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 11:04:45.448300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 11:04:45.449380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:04:45.451626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. Aug 26 11:04:45.451626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.451626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:45.451626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.451626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:45.451626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:45.451626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:45.451626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:04:45.451626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:04:45.451626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. Aug 26 11:04:45.451626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.451626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-dc1a786e-5593-41b4-b89e-68b52389a24f tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Returning 404 to user: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:04:45.451626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-dc1a786e-5593-41b4-b89e-68b52389a24f tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d" status: 404 len: 109 microversion: 2.1 time: 0.096294 Aug 26 11:04:45.451626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 16/34] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 11:04:45 2022] DELETE /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:04:45.458039 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-cc1d0118-e34d-46a5-8f81-ef82832eb74e tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Calling method '.version_select at 0x7f1a698c0940>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:45.581154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-cc1d0118-e34d-46a5-8f81-ef82832eb74e tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] HTTP exception thrown: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-cc1d0118-e34d-46a5-8f81-ef82832eb74e tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Request method failure captured: Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d HTTP/1.1 Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKjASnl3ZH9iFv4YPm0mACjUF2Pe7_CJJ_hDt8rxh0WZXINvDdXuFKow_2MjndCn1z8zjVOR3OZgJFo_mg3ap_T9zfUDULIdVLdwLlhKbH7UxUt2JiOKOAZFvSQUtJBT7dVAV2aXtQC1Da58uwDNUM1_5FY7pM2RjqHO4RG82_-l8_0 Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: 41e03cfe608f47beabce918524dfa2b6 Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2083018949 Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:04:45.583190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:04:45.584527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_41e03cfe608f47beabce918524dfa2b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/41e03cfe608f47beabce918524dfa2b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/41e03cfe608f47beabce918524dfa2b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/41e03cfe608f47beabce918524dfa2b6"}]}] Aug 26 11:04:45.584527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2083018949 Aug 26 11:04:45.584527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: 41e03cfe608f47beabce918524dfa2b6 Aug 26 11:04:45.584527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2083018949 Aug 26 11:04:45.584527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-VolumesSnapshotsTestJSON-2083018949-project Aug 26 11:04:45.584527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:04:45.584527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:04:45.584527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: bbeef9cfedfa4bd386617b92ba1dfc90 Aug 26 11:04:45.584527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2083018949-project Aug 26 11:04:45.584527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: Aug 26 11:04:45.584527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. Aug 26 11:04:45.584527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': '9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d'} Aug 26 11:04:45.584527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. (HTTP 404) (Request-ID: req-0bf490e5-f622-4c93-ba22-3c24aae831ce) Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:45.585924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 11:04:45.587126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 11:04:45.588907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:04:45.590079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. Aug 26 11:04:45.590079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.590079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:04:45.590079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.590079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:04:45.590079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:04:45.590079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:04:45.590079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:04:45.590079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:04:45.590079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. Aug 26 11:04:45.590079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:04:45.590079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-cc1d0118-e34d-46a5-8f81-ef82832eb74e tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] Returning 404 to user: Volume 9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:04:45.590079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-cc1d0118-e34d-46a5-8f81-ef82832eb74e tempest-VolumesSnapshotsTestJSON-2083018949 tempest-VolumesSnapshotsTestJSON-2083018949-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d" status: 404 len: 109 microversion: 2.1 time: 0.133546 Aug 26 11:04:45.590079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 17/35] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 11:04:45 2022] GET /compute/v2.1/os-volumes/9c8fee15-0f6c-4d1a-b75a-b72b7665dd2d => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 11:04:47.122536 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:04:47.123829 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:04:47.124522 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:04:47.125173 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:04:47.125734 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:04:47.152192 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:47.153793 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:47.154637 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:47.160742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:47.161507 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:47.162172 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:47.285907 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Getting quotas for project 7db3b983562e49cfbb77c9e64b6e6cb9. Resources: {'instances', 'ram', 'cores'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:04:47.308030 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Getting quotas for user d6dbbabdd88c4c088bc91e6c43531318 and project 7db3b983562e49cfbb77c9e64b6e6cb9. Resources: {'instances', 'ram', 'cores'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:04:47.346504 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:04:47.365371 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:04:47.555849 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c94281da-5950-4c11-be5f-1d35ea27ad79 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.258305 Aug 26 11:04:47.565336 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 19/36] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:04:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 4270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:04:47.581201 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-61bdf8f2-b15a-4954-9316-340c2c58058f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:47.582663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-61bdf8f2-b15a-4954-9316-340c2c58058f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:04:47.618688 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1943941079", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452", "networks": [{"uuid": "a3605fd0-c91e-456f-9657-d4e1b4712c93"}]}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:04:47.924749 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.network.neutron [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] validate_networks() for [('a3605fd0-c91e-456f-9657-d4e1b4712c93', None, None, None, None, None)] {{(pid=120605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:04:48.149122 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-61bdf8f2-b15a-4954-9316-340c2c58058f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:04:48.202817 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-61bdf8f2-b15a-4954-9316-340c2c58058f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1222 microversion: 2.1 time: 0.630431 Aug 26 11:04:48.205455 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 20/37] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:04:47 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1222 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:04:48.701577 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1484201024", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:04:48.852827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] validate_networks() for [('60347e96-6659-4e98-860c-bd915107c9fd', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:04:51.247847 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:04:51.248468 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:04:51.248742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:04:51.249155 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:04:51.249988 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:04:51.266592 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:51.267662 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:51.268343 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:51.270665 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:51.271367 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:51.271894 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:51.319761 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Getting quotas for project 7db3b983562e49cfbb77c9e64b6e6cb9. Resources: {'instances', 'ram', 'cores'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:04:51.324756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Getting quotas for user d6dbbabdd88c4c088bc91e6c43531318 and project 7db3b983562e49cfbb77c9e64b6e6cb9. Resources: {'instances', 'ram', 'cores'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:04:51.351720 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:04:51.358033 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:04:51.488665 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Flavor limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:04:51.489733 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Image limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:04:51.490245 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Flavor pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:04:51.490814 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Image pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:04:51.491999 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:04:51.503593 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ba9d571e-e5a9-48af-b6bb-655a68d4f3c0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.807410 Aug 26 11:04:51.507824 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 21/38] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:04:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 2813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:04:51.567757 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:51.578573 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:51.580188 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:51.584414 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:51.585839 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:51.595004 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:51.722629 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Getting quotas for project 6a00e426be1a41b4b37f7825869ac5cb. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:04:51.733632 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Getting quotas for user d074367ea693406badce6f7b468f3147 and project 6a00e426be1a41b4b37f7825869ac5cb. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:04:51.805848 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Going to run 1 instances... {{(pid=120605) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:04:51.820115 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:04:52.066806 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c9783b82-877b-4f1f-bafd-1b5458fe1291 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.014171 Aug 26 11:04:52.068551 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 18/39] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:04:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 5025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:04:52.767720 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c8a54aa5-3f05-4021-976a-93ae2e432a51 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Action: 'create', calling method: .version_select at 0x7f1a68f3da60>, body: {"keypair": {"name": "tempest-keypair-518548241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB44xyMlmXH8tlsw8n/9Af7OoYd8SY9uLugiXiEq4xcmT6ondmb6tOoDZrmmpuXgxZ2+VJehjU+hC+mrBhyI3ELDTaTW6krV5WPBCgcSU1/TTeV/FdwaLVLVcXhB2jav5w=="}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:04:52.826860 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-c8a54aa5-3f05-4021-976a-93ae2e432a51 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Getting quotas for project 78251e5bdb2548d1bb18aacd4ccbcd34. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:04:52.842741 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-c8a54aa5-3f05-4021-976a-93ae2e432a51 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Getting quotas for user aedac3f62dd94f87b968f6c71d68a0a3 and project 78251e5bdb2548d1bb18aacd4ccbcd34. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:04:52.934903 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c8a54aa5-3f05-4021-976a-93ae2e432a51 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.424685 Aug 26 11:04:52.935908 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 22/40] 10.222.0.40 () {62 vars in 1200 bytes} [Fri Aug 26 11:04:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1428 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 26 11:04:52.958365 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-32f66377-4b7c-4767-8879-b3a2cbee5742 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:52.959330 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-32f66377-4b7c-4767-8879-b3a2cbee5742 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:04:53.265659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c8482fb6-ff76-4620-8919-8b6c5ddf689d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Action: 'create', calling method: .version_select at 0x7f1a68f08af0>, body: {"keypair": {"name": "tempest-keypair-597777171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqR9xhyTtbaTHQD6NedWuzG+qrTXs4LM8DO5Mg0EvlOCIw2t+l5IWFcaqu5Sxrqj75AEgSx8pB3V0Ye9YZuiI+XZ01yPSdfiIE+Q8AGOmPsNh2CSa1HYvuoVMmazbUlYw=="}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:04:53.339936 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-c8482fb6-ff76-4620-8919-8b6c5ddf689d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Getting quotas for project 0fa496929354424ca7d024a8279f2e80. Resources: {'key_pairs'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:04:53.351951 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-c8482fb6-ff76-4620-8919-8b6c5ddf689d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Getting quotas for user 163e8be86d5640f88893c50e6f3a8af7 and project 0fa496929354424ca7d024a8279f2e80. Resources: {'key_pairs'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:04:53.464092 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c8482fb6-ff76-4620-8919-8b6c5ddf689d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.392529 Aug 26 11:04:53.464942 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 19/41] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 11:04:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:04:53.478392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-8e62ef0e-83cb-4f98-b2f2-04a7b394b839 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:53.492850 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-8e62ef0e-83cb-4f98-b2f2-04a7b394b839 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:04:53.532676 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8e62ef0e-83cb-4f98-b2f2-04a7b394b839 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:53.544799 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8e62ef0e-83cb-4f98-b2f2-04a7b394b839 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:53.550660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8e62ef0e-83cb-4f98-b2f2-04a7b394b839 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:53.551742 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8e62ef0e-83cb-4f98-b2f2-04a7b394b839 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:53.555671 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8e62ef0e-83cb-4f98-b2f2-04a7b394b839 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:53.556350 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8e62ef0e-83cb-4f98-b2f2-04a7b394b839 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:53.574740 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-32f66377-4b7c-4767-8879-b3a2cbee5742 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:04:53.603677 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-32f66377-4b7c-4767-8879-b3a2cbee5742 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1222 microversion: 2.1 time: 0.666576 Aug 26 11:04:53.606969 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 23/42] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:04:52 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1222 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:04:54.158442 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8e62ef0e-83cb-4f98-b2f2-04a7b394b839 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:04:54.217119 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-8e62ef0e-83cb-4f98-b2f2-04a7b394b839 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1219 microversion: 2.1 time: 0.739859 Aug 26 11:04:54.217925 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 20/43] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:04:53 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1219 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:04:54.629791 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-13d20996-2de7-41e3-96b6-d610f70c82af tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:54.630541 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-13d20996-2de7-41e3-96b6-d610f70c82af tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:04:54.645152 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-13d20996-2de7-41e3-96b6-d610f70c82af tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:54.649657 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-13d20996-2de7-41e3-96b6-d610f70c82af tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:54.654468 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-13d20996-2de7-41e3-96b6-d610f70c82af tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:54.656065 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-13d20996-2de7-41e3-96b6-d610f70c82af tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:54.656704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-13d20996-2de7-41e3-96b6-d610f70c82af tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:54.657304 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-13d20996-2de7-41e3-96b6-d610f70c82af tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:55.242431 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-ccbbeb4c-c26b-4965-aa4e-e02b06e9b85f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:55.243068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-ccbbeb4c-c26b-4965-aa4e-e02b06e9b85f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:04:55.259646 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ccbbeb4c-c26b-4965-aa4e-e02b06e9b85f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:55.261998 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ccbbeb4c-c26b-4965-aa4e-e02b06e9b85f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:55.263271 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ccbbeb4c-c26b-4965-aa4e-e02b06e9b85f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:55.266926 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ccbbeb4c-c26b-4965-aa4e-e02b06e9b85f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:55.268004 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ccbbeb4c-c26b-4965-aa4e-e02b06e9b85f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:55.271113 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ccbbeb4c-c26b-4965-aa4e-e02b06e9b85f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:55.318934 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-13d20996-2de7-41e3-96b6-d610f70c82af tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:04:55.361046 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-13d20996-2de7-41e3-96b6-d610f70c82af tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1274 microversion: 2.1 time: 0.737123 Aug 26 11:04:55.380075 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 24/44] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:04:54 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1274 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:04:55.594478 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-ccbbeb4c-c26b-4965-aa4e-e02b06e9b85f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:04:55.607019 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-ccbbeb4c-c26b-4965-aa4e-e02b06e9b85f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1275 microversion: 2.1 time: 0.366362 Aug 26 11:04:55.612368 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 21/45] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:04:55 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1275 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:04:56.389530 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-47ea9a3d-bd0f-4454-8309-ead6f57fb50e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:56.393270 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-47ea9a3d-bd0f-4454-8309-ead6f57fb50e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:04:56.411076 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-47ea9a3d-bd0f-4454-8309-ead6f57fb50e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:56.425591 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-47ea9a3d-bd0f-4454-8309-ead6f57fb50e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:56.427392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-47ea9a3d-bd0f-4454-8309-ead6f57fb50e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:56.430192 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-47ea9a3d-bd0f-4454-8309-ead6f57fb50e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:56.430958 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-47ea9a3d-bd0f-4454-8309-ead6f57fb50e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:56.432794 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-47ea9a3d-bd0f-4454-8309-ead6f57fb50e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:56.648506 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-01107b4a-1f03-4da5-923e-54ccfd63a932 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:56.649335 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-01107b4a-1f03-4da5-923e-54ccfd63a932 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:04:56.668666 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-01107b4a-1f03-4da5-923e-54ccfd63a932 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:56.670696 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-01107b4a-1f03-4da5-923e-54ccfd63a932 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:56.673085 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-01107b4a-1f03-4da5-923e-54ccfd63a932 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:56.678302 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-01107b4a-1f03-4da5-923e-54ccfd63a932 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:56.682894 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-01107b4a-1f03-4da5-923e-54ccfd63a932 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:56.684275 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-01107b4a-1f03-4da5-923e-54ccfd63a932 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:56.810665 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-47ea9a3d-bd0f-4454-8309-ead6f57fb50e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:04:56.831126 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-47ea9a3d-bd0f-4454-8309-ead6f57fb50e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1292 microversion: 2.1 time: 0.443504 Aug 26 11:04:56.847871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 25/46] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:04:56 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1292 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:04:56.907014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-01107b4a-1f03-4da5-923e-54ccfd63a932 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:04:56.932657 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-01107b4a-1f03-4da5-923e-54ccfd63a932 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1273 microversion: 2.1 time: 0.282720 Aug 26 11:04:56.947052 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 22/47] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:04:56 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1273 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:04:57.863580 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3fa44355-d883-4f9f-a703-abe91abe6104 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:57.864287 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3fa44355-d883-4f9f-a703-abe91abe6104 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:04:57.874403 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3fa44355-d883-4f9f-a703-abe91abe6104 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:57.876494 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3fa44355-d883-4f9f-a703-abe91abe6104 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:57.877013 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3fa44355-d883-4f9f-a703-abe91abe6104 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:57.879681 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3fa44355-d883-4f9f-a703-abe91abe6104 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:57.880337 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3fa44355-d883-4f9f-a703-abe91abe6104 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:57.885880 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3fa44355-d883-4f9f-a703-abe91abe6104 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:57.962657 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-ce0e235d-ce77-431a-a355-52e1bf945c27 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:57.976019 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-ce0e235d-ce77-431a-a355-52e1bf945c27 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:04:58.010420 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ce0e235d-ce77-431a-a355-52e1bf945c27 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:58.010915 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ce0e235d-ce77-431a-a355-52e1bf945c27 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:58.011554 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ce0e235d-ce77-431a-a355-52e1bf945c27 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:58.012054 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ce0e235d-ce77-431a-a355-52e1bf945c27 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:58.012507 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ce0e235d-ce77-431a-a355-52e1bf945c27 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:58.012928 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ce0e235d-ce77-431a-a355-52e1bf945c27 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:58.676681 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3fa44355-d883-4f9f-a703-abe91abe6104 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:04:58.708505 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3fa44355-d883-4f9f-a703-abe91abe6104 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1280 microversion: 2.1 time: 0.850752 Aug 26 11:04:58.739811 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 26/48] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:04:57 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1280 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:04:59.474131 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-ce0e235d-ce77-431a-a355-52e1bf945c27 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:04:59.486861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-ce0e235d-ce77-431a-a355-52e1bf945c27 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1273 microversion: 2.1 time: 1.530759 Aug 26 11:04:59.490323 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 23/49] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:04:57 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1273 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:04:59.735769 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-87785fc0-be0d-4279-9f73-56a53cdcf0c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:04:59.736557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-87785fc0-be0d-4279-9f73-56a53cdcf0c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:04:59.756786 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-87785fc0-be0d-4279-9f73-56a53cdcf0c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:59.758780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-87785fc0-be0d-4279-9f73-56a53cdcf0c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:59.760015 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-87785fc0-be0d-4279-9f73-56a53cdcf0c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:04:59.765204 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-87785fc0-be0d-4279-9f73-56a53cdcf0c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:04:59.766495 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-87785fc0-be0d-4279-9f73-56a53cdcf0c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:04:59.768766 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-87785fc0-be0d-4279-9f73-56a53cdcf0c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:00.008723 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-87785fc0-be0d-4279-9f73-56a53cdcf0c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:00.028120 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-87785fc0-be0d-4279-9f73-56a53cdcf0c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1280 microversion: 2.1 time: 0.288154 Aug 26 11:05:00.029135 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 27/50] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:04:59 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1280 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:00.513292 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4654fc3a-e93a-45d1-95fe-1e23b5b52afc tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:00.514552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4654fc3a-e93a-45d1-95fe-1e23b5b52afc tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:00.531223 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4654fc3a-e93a-45d1-95fe-1e23b5b52afc tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:00.538733 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4654fc3a-e93a-45d1-95fe-1e23b5b52afc tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:00.541226 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4654fc3a-e93a-45d1-95fe-1e23b5b52afc tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:00.542228 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4654fc3a-e93a-45d1-95fe-1e23b5b52afc tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:00.544612 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4654fc3a-e93a-45d1-95fe-1e23b5b52afc tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:00.545642 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4654fc3a-e93a-45d1-95fe-1e23b5b52afc tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:01.050237 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-da0acf06-d522-45d9-bb1f-f68df46ea748 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:01.050977 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-da0acf06-d522-45d9-bb1f-f68df46ea748 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:01.065169 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da0acf06-d522-45d9-bb1f-f68df46ea748 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:01.073685 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da0acf06-d522-45d9-bb1f-f68df46ea748 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:01.075758 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da0acf06-d522-45d9-bb1f-f68df46ea748 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:01.077753 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da0acf06-d522-45d9-bb1f-f68df46ea748 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:01.080381 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da0acf06-d522-45d9-bb1f-f68df46ea748 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:01.081040 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da0acf06-d522-45d9-bb1f-f68df46ea748 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:01.301325 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=4 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:01.662185 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:02.026166 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4654fc3a-e93a-45d1-95fe-1e23b5b52afc tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:02.044049 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4654fc3a-e93a-45d1-95fe-1e23b5b52afc tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1315 microversion: 2.1 time: 1.533601 Aug 26 11:05:02.047011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 24/51] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:00 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1315 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:02.409703 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-da0acf06-d522-45d9-bb1f-f68df46ea748 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:02.422648 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-da0acf06-d522-45d9-bb1f-f68df46ea748 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1322 microversion: 2.1 time: 1.376130 Aug 26 11:05:02.441168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 28/52] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:01 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1322 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:02.580647 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1119527545", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d146ca4-0dba-4d73-bb20-a2cc8eb29a90"}], "security_groups": [{"name": "tempest-securitygroup--1658153760"}], "key_name": "tempest-keypair-518548241", "user_data": "}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:03.064847 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e665121e-410c-4c22-968b-c88c48318f0e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:03.065538 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e665121e-410c-4c22-968b-c88c48318f0e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:03.081260 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e665121e-410c-4c22-968b-c88c48318f0e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:03.081773 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e665121e-410c-4c22-968b-c88c48318f0e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:03.082248 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e665121e-410c-4c22-968b-c88c48318f0e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:03.082966 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e665121e-410c-4c22-968b-c88c48318f0e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:03.088189 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e665121e-410c-4c22-968b-c88c48318f0e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:03.090563 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e665121e-410c-4c22-968b-c88c48318f0e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:03.381768 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=10 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:03.579309 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=20 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:03.638600 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.network.neutron [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] validate_networks() for [('1d146ca4-0dba-4d73-bb20-a2cc8eb29a90', None, None, None, None, None)] {{(pid=120605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:05:04.102760 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e665121e-410c-4c22-968b-c88c48318f0e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:04.128539 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e665121e-410c-4c22-968b-c88c48318f0e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1315 microversion: 2.1 time: 1.065833 Aug 26 11:05:04.131266 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 29/53] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:03 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1315 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:04.152493 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9562c9f0-49db-48d3-b8f5-5ac629770504 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:04.159298 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9562c9f0-49db-48d3-b8f5-5ac629770504 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:04.185058 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9562c9f0-49db-48d3-b8f5-5ac629770504 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:04.185921 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9562c9f0-49db-48d3-b8f5-5ac629770504 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:04.186577 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9562c9f0-49db-48d3-b8f5-5ac629770504 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:04.187459 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9562c9f0-49db-48d3-b8f5-5ac629770504 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:04.188068 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9562c9f0-49db-48d3-b8f5-5ac629770504 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:04.188772 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9562c9f0-49db-48d3-b8f5-5ac629770504 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:04.863605 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9562c9f0-49db-48d3-b8f5-5ac629770504 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:04.884010 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9562c9f0-49db-48d3-b8f5-5ac629770504 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1322 microversion: 2.1 time: 0.744385 Aug 26 11:05:04.885916 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 30/54] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:04 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1322 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:05.154601 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-677b991c-d23b-4cf1-a653-242bf52e6c53 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:05.155343 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-677b991c-d23b-4cf1-a653-242bf52e6c53 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:05.178028 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-677b991c-d23b-4cf1-a653-242bf52e6c53 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:05.207352 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-677b991c-d23b-4cf1-a653-242bf52e6c53 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:05.212035 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-677b991c-d23b-4cf1-a653-242bf52e6c53 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:05.212865 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-677b991c-d23b-4cf1-a653-242bf52e6c53 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:05.213359 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-677b991c-d23b-4cf1-a653-242bf52e6c53 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:05.218893 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-677b991c-d23b-4cf1-a653-242bf52e6c53 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:06.096857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Flavor limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:05:06.098210 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Image limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:05:06.099004 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Flavor pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:05:06.099983 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Image pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:05:06.102005 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:05:06.127952 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:06.129263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:06.132532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:06.135059 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:06.137063 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:06.137680 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:06.198586 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-677b991c-d23b-4cf1-a653-242bf52e6c53 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:06.206921 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Getting quotas for project 78251e5bdb2548d1bb18aacd4ccbcd34. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:05:06.214365 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-677b991c-d23b-4cf1-a653-242bf52e6c53 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1315 microversion: 2.1 time: 1.057503 Aug 26 11:05:06.214962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Getting quotas for user aedac3f62dd94f87b968f6c71d68a0a3 and project 78251e5bdb2548d1bb18aacd4ccbcd34. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:05:06.215552 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 31/55] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:05 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1315 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:06.265361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Going to run 1 instances... {{(pid=120605) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:05:06.273998 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:05:06.405745 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-e3395c21-6b87-400b-94c1-be035c2eb09f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.829110 Aug 26 11:05:06.408120 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 25/56] 10.222.0.40 () {62 vars in 1188 bytes} [Fri Aug 26 11:05:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 3835 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 26 11:05:06.420218 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1706769e-4f17-4319-bca7-741a1cc6301e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:06.425231 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-1706769e-4f17-4319-bca7-741a1cc6301e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:06.440621 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1706769e-4f17-4319-bca7-741a1cc6301e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:06.442585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1706769e-4f17-4319-bca7-741a1cc6301e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:06.444113 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1706769e-4f17-4319-bca7-741a1cc6301e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:06.447889 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1706769e-4f17-4319-bca7-741a1cc6301e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:06.448531 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1706769e-4f17-4319-bca7-741a1cc6301e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:06.449379 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1706769e-4f17-4319-bca7-741a1cc6301e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:06.735843 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-5ac2bf9f-c1fe-4c0b-b294-c72d94c45aa7 req-84498bdd-689a-45d1-b314-0d2afabc2172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04076a90-f7d2-4295-a167-5eab08bfdf37", "tag": "25f6fa0a-7f42-4b62-acf1-e6c9ee0ad2ad"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:06.802450 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-5ac2bf9f-c1fe-4c0b-b294-c72d94c45aa7 req-84498bdd-689a-45d1-b314-0d2afabc2172 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:06.804741 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-5ac2bf9f-c1fe-4c0b-b294-c72d94c45aa7 req-84498bdd-689a-45d1-b314-0d2afabc2172 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:06.806035 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-5ac2bf9f-c1fe-4c0b-b294-c72d94c45aa7 req-84498bdd-689a-45d1-b314-0d2afabc2172 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:06.854739 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-5ac2bf9f-c1fe-4c0b-b294-c72d94c45aa7 req-84498bdd-689a-45d1-b314-0d2afabc2172 service nova] Creating event network-changed:25f6fa0a-7f42-4b62-acf1-e6c9ee0ad2ad for instance 04076a90-f7d2-4295-a167-5eab08bfdf37 on hv-cinder-85236 Aug 26 11:05:06.858574 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-5ac2bf9f-c1fe-4c0b-b294-c72d94c45aa7 req-84498bdd-689a-45d1-b314-0d2afabc2172 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120604) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 26 11:05:06.859437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-5ac2bf9f-c1fe-4c0b-b294-c72d94c45aa7 req-84498bdd-689a-45d1-b314-0d2afabc2172 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120604) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 26 11:05:06.860807 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5df10591-696f-4b62-b3a5-008ae30bfb3e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:06.862826 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5df10591-696f-4b62-b3a5-008ae30bfb3e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:06.863653 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5df10591-696f-4b62-b3a5-008ae30bfb3e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:06.866238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5df10591-696f-4b62-b3a5-008ae30bfb3e None None] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:06.867203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5df10591-696f-4b62-b3a5-008ae30bfb3e None None] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:06.869700 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5df10591-696f-4b62-b3a5-008ae30bfb3e None None] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:06.891959 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.compute.rpcapi [None req-5df10591-696f-4b62-b3a5-008ae30bfb3e None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 26 11:05:06.896244 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5df10591-696f-4b62-b3a5-008ae30bfb3e None None] Releasing lock "compute-rpcapi-router" {{(pid=120604) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 26 11:05:06.929862 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5df10591-696f-4b62-b3a5-008ae30bfb3e None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.712850 Aug 26 11:05:06.932823 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 32/57] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:05:06.945742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-943e9106-dec5-4553-b472-b89e23bd795a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:06.961637 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-943e9106-dec5-4553-b472-b89e23bd795a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:07.455597 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1706769e-4f17-4319-bca7-741a1cc6301e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:07.468098 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1706769e-4f17-4319-bca7-741a1cc6301e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1322 microversion: 2.1 time: 1.057989 Aug 26 11:05:07.486570 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 26/58] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:06 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1322 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:07.505504 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1563306753", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b228cae9-e04f-418f-b036-bf43310a5e0b"}], "security_groups": [{"name": "tempest-securitygroup--1689251817"}], "key_name": "tempest-keypair-597777171", "user_data": "}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:07.528340 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-943e9106-dec5-4553-b472-b89e23bd795a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:07.539271 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-943e9106-dec5-4553-b472-b89e23bd795a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:07.551896 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-943e9106-dec5-4553-b472-b89e23bd795a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:07.556416 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-943e9106-dec5-4553-b472-b89e23bd795a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1281 microversion: 2.20 time: 0.619222 Aug 26 11:05:07.565398 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 33/59] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:06 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1281 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:07.581966 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5447f473-16e3-4693-a6d7-4298a53ffc35 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:07.581966 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5447f473-16e3-4693-a6d7-4298a53ffc35 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:07.601754 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5447f473-16e3-4693-a6d7-4298a53ffc35 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:07.602531 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5447f473-16e3-4693-a6d7-4298a53ffc35 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:07.612822 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5447f473-16e3-4693-a6d7-4298a53ffc35 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:07.612822 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5447f473-16e3-4693-a6d7-4298a53ffc35 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:07.612822 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5447f473-16e3-4693-a6d7-4298a53ffc35 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:07.612822 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5447f473-16e3-4693-a6d7-4298a53ffc35 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:07.994620 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.network.neutron [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] validate_networks() for [('b228cae9-e04f-418f-b036-bf43310a5e0b', None, None, None, None, None)] {{(pid=120605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:05:08.470487 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5447f473-16e3-4693-a6d7-4298a53ffc35 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:08.487913 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5447f473-16e3-4693-a6d7-4298a53ffc35 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1315 microversion: 2.1 time: 0.918568 Aug 26 11:05:08.489088 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 34/60] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:07 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1315 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:08.907277 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-a5427211-3233-4ac0-a122-c5cb2b60bbb5 req-ad9ba35b-f3ab-4a41-9763-2b7bc2f1c8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b78ce714-fb3b-4478-9d40-7e298961441e", "tag": "57c9d59f-1551-4d0a-834b-3fb18f12f22f"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:08.923455 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-a5427211-3233-4ac0-a122-c5cb2b60bbb5 req-ad9ba35b-f3ab-4a41-9763-2b7bc2f1c8e0 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:08.926932 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-a5427211-3233-4ac0-a122-c5cb2b60bbb5 req-ad9ba35b-f3ab-4a41-9763-2b7bc2f1c8e0 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:08.927080 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-a5427211-3233-4ac0-a122-c5cb2b60bbb5 req-ad9ba35b-f3ab-4a41-9763-2b7bc2f1c8e0 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:08.948597 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-a5427211-3233-4ac0-a122-c5cb2b60bbb5 req-ad9ba35b-f3ab-4a41-9763-2b7bc2f1c8e0 service nova] Creating event network-changed:57c9d59f-1551-4d0a-834b-3fb18f12f22f for instance b78ce714-fb3b-4478-9d40-7e298961441e on hv-cinder-85236 Aug 26 11:05:08.955548 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-a5427211-3233-4ac0-a122-c5cb2b60bbb5 req-ad9ba35b-f3ab-4a41-9763-2b7bc2f1c8e0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.464718 Aug 26 11:05:08.956748 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 35/61] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:05:08.964431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-cf2a8ddc-2959-4b2f-9d6e-0a0c3e35956c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:08.965726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-cf2a8ddc-2959-4b2f-9d6e-0a0c3e35956c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:08.975724 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf2a8ddc-2959-4b2f-9d6e-0a0c3e35956c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:08.976441 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf2a8ddc-2959-4b2f-9d6e-0a0c3e35956c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:08.976839 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf2a8ddc-2959-4b2f-9d6e-0a0c3e35956c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:08.977619 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf2a8ddc-2959-4b2f-9d6e-0a0c3e35956c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:08.978260 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf2a8ddc-2959-4b2f-9d6e-0a0c3e35956c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:08.978761 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf2a8ddc-2959-4b2f-9d6e-0a0c3e35956c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:09.052839 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Flavor limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:05:09.053947 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Image limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:05:09.054808 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Flavor pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:05:09.055262 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Image pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:05:09.055707 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:05:09.064854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:09.065345 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:09.065779 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:09.066713 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:09.067337 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:09.067924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:09.099849 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Getting quotas for project 0fa496929354424ca7d024a8279f2e80. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:05:09.104770 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Getting quotas for user 163e8be86d5640f88893c50e6f3a8af7 and project 0fa496929354424ca7d024a8279f2e80. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:05:09.117268 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Going to run 1 instances... {{(pid=120605) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:05:09.119589 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:05:09.148668 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-cf2a8ddc-2959-4b2f-9d6e-0a0c3e35956c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:09.156807 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-cf2a8ddc-2959-4b2f-9d6e-0a0c3e35956c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1322 microversion: 2.1 time: 0.198750 Aug 26 11:05:09.157695 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 36/62] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:08 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:09.162507 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3b3ee746-b97d-46eb-8037-ea23b7ca4e51 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:09.163848 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3b3ee746-b97d-46eb-8037-ea23b7ca4e51 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:09.169739 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b3ee746-b97d-46eb-8037-ea23b7ca4e51 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:09.170429 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b3ee746-b97d-46eb-8037-ea23b7ca4e51 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:09.171074 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b3ee746-b97d-46eb-8037-ea23b7ca4e51 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:09.171780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b3ee746-b97d-46eb-8037-ea23b7ca4e51 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:09.172245 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b3ee746-b97d-46eb-8037-ea23b7ca4e51 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:09.172674 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b3ee746-b97d-46eb-8037-ea23b7ca4e51 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:09.174486 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-52dbb8b9-e3be-4f90-87ea-967e90e8e1fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.686217 Aug 26 11:05:09.180240 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 27/63] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:05:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:05:09.186026 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-541a7816-52dc-4087-ab8c-c531a6e0e960 req-b3038b21-920c-4e8f-9bee-c3adc57ae513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcc3934b-d598-47c2-9fcb-404b2fe5a478", "tag": "e09f28fa-7224-41d2-b9f8-5ce2b96f6acc"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:09.200765 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-541a7816-52dc-4087-ab8c-c531a6e0e960 req-b3038b21-920c-4e8f-9bee-c3adc57ae513 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:09.201302 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-541a7816-52dc-4087-ab8c-c531a6e0e960 req-b3038b21-920c-4e8f-9bee-c3adc57ae513 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:09.201739 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-541a7816-52dc-4087-ab8c-c531a6e0e960 req-b3038b21-920c-4e8f-9bee-c3adc57ae513 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:09.221747 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-541a7816-52dc-4087-ab8c-c531a6e0e960 req-b3038b21-920c-4e8f-9bee-c3adc57ae513 service nova] Creating event network-changed:e09f28fa-7224-41d2-b9f8-5ce2b96f6acc for instance dcc3934b-d598-47c2-9fcb-404b2fe5a478 on hv-cinder-85236 Aug 26 11:05:09.222863 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-541a7816-52dc-4087-ab8c-c531a6e0e960 req-b3038b21-920c-4e8f-9bee-c3adc57ae513 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 26 11:05:09.223414 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-541a7816-52dc-4087-ab8c-c531a6e0e960 req-b3038b21-920c-4e8f-9bee-c3adc57ae513 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 26 11:05:09.224602 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b20535c3-e07c-42f0-a36a-1f9ae7e905a9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:09.225777 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b20535c3-e07c-42f0-a36a-1f9ae7e905a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:09.226377 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b20535c3-e07c-42f0-a36a-1f9ae7e905a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:09.227366 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b20535c3-e07c-42f0-a36a-1f9ae7e905a9 None None] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:09.227967 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b20535c3-e07c-42f0-a36a-1f9ae7e905a9 None None] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:09.228540 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b20535c3-e07c-42f0-a36a-1f9ae7e905a9 None None] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:09.237570 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.compute.rpcapi [None req-b20535c3-e07c-42f0-a36a-1f9ae7e905a9 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 26 11:05:09.238475 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b20535c3-e07c-42f0-a36a-1f9ae7e905a9 None None] Releasing lock "compute-rpcapi-router" {{(pid=120605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 26 11:05:09.258599 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b20535c3-e07c-42f0-a36a-1f9ae7e905a9 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076940 Aug 26 11:05:09.259433 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 28/64] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:05:09.266352 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-9d384528-dd5f-4af9-b212-e28b66aca081 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:09.267441 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9d384528-dd5f-4af9-b212-e28b66aca081 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:09.288393 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3b3ee746-b97d-46eb-8037-ea23b7ca4e51 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:09.297836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3b3ee746-b97d-46eb-8037-ea23b7ca4e51 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:09.299379 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3b3ee746-b97d-46eb-8037-ea23b7ca4e51 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:09.300651 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3b3ee746-b97d-46eb-8037-ea23b7ca4e51 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1333 microversion: 2.20 time: 0.141700 Aug 26 11:05:09.301384 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 37/65] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:09 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1333 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:09.332112 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9d384528-dd5f-4af9-b212-e28b66aca081 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:09.344375 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-9d384528-dd5f-4af9-b212-e28b66aca081 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1237 microversion: 2.1 time: 0.083631 Aug 26 11:05:09.346045 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 29/66] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:09 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:09.514061 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f8d20ae8-c935-4ba6-82ab-4d9327cecc7c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:09.514691 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f8d20ae8-c935-4ba6-82ab-4d9327cecc7c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:09.520854 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8d20ae8-c935-4ba6-82ab-4d9327cecc7c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:09.521334 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8d20ae8-c935-4ba6-82ab-4d9327cecc7c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:09.521789 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8d20ae8-c935-4ba6-82ab-4d9327cecc7c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:09.523279 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8d20ae8-c935-4ba6-82ab-4d9327cecc7c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:09.523996 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8d20ae8-c935-4ba6-82ab-4d9327cecc7c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:09.524537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8d20ae8-c935-4ba6-82ab-4d9327cecc7c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:09.672275 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f8d20ae8-c935-4ba6-82ab-4d9327cecc7c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:09.681447 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f8d20ae8-c935-4ba6-82ab-4d9327cecc7c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1315 microversion: 2.1 time: 0.171578 Aug 26 11:05:09.682322 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 38/67] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:09 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:10.179273 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5e930aed-beb2-4621-9eba-ad0e16522dd7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:10.180658 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5e930aed-beb2-4621-9eba-ad0e16522dd7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:10.187333 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5e930aed-beb2-4621-9eba-ad0e16522dd7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:10.187944 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5e930aed-beb2-4621-9eba-ad0e16522dd7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:10.188253 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5e930aed-beb2-4621-9eba-ad0e16522dd7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:10.188952 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5e930aed-beb2-4621-9eba-ad0e16522dd7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:10.189409 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5e930aed-beb2-4621-9eba-ad0e16522dd7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:10.189838 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5e930aed-beb2-4621-9eba-ad0e16522dd7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:10.321187 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5e930aed-beb2-4621-9eba-ad0e16522dd7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:10.323985 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-fc82bb1b-a190-4027-b9eb-02d535d0772e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:10.324646 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-fc82bb1b-a190-4027-b9eb-02d535d0772e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:10.329411 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5e930aed-beb2-4621-9eba-ad0e16522dd7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1322 microversion: 2.1 time: 0.154690 Aug 26 11:05:10.330005 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 30/68] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:10 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:10.331450 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc82bb1b-a190-4027-b9eb-02d535d0772e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:10.331931 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc82bb1b-a190-4027-b9eb-02d535d0772e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:10.332369 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc82bb1b-a190-4027-b9eb-02d535d0772e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:10.333054 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc82bb1b-a190-4027-b9eb-02d535d0772e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:10.333497 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc82bb1b-a190-4027-b9eb-02d535d0772e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:10.333914 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc82bb1b-a190-4027-b9eb-02d535d0772e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:10.364614 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-214985bf-9f1c-40bc-b62a-639b4fcee0cc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:10.365220 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-214985bf-9f1c-40bc-b62a-639b4fcee0cc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:10.372496 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-214985bf-9f1c-40bc-b62a-639b4fcee0cc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:10.372973 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-214985bf-9f1c-40bc-b62a-639b4fcee0cc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:10.373404 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-214985bf-9f1c-40bc-b62a-639b4fcee0cc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:10.374111 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-214985bf-9f1c-40bc-b62a-639b4fcee0cc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:10.374560 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-214985bf-9f1c-40bc-b62a-639b4fcee0cc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:10.374975 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-214985bf-9f1c-40bc-b62a-639b4fcee0cc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:10.395211 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-fc82bb1b-a190-4027-b9eb-02d535d0772e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:10.398292 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=87 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:10.405163 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-fc82bb1b-a190-4027-b9eb-02d535d0772e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:10.406625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-fc82bb1b-a190-4027-b9eb-02d535d0772e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:10.407741 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-fc82bb1b-a190-4027-b9eb-02d535d0772e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1333 microversion: 2.20 time: 0.087550 Aug 26 11:05:10.408283 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 39/69] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:10 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:10.442213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-214985bf-9f1c-40bc-b62a-639b4fcee0cc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:10.451040 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-214985bf-9f1c-40bc-b62a-639b4fcee0cc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1241 microversion: 2.1 time: 0.090371 Aug 26 11:05:10.451604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 31/70] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:10 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:05:10.703093 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d0feaeb2-32e3-4fe6-b056-fe60141157d3 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:10.703696 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d0feaeb2-32e3-4fe6-b056-fe60141157d3 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:10.705511 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:10.710953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0feaeb2-32e3-4fe6-b056-fe60141157d3 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:10.711437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0feaeb2-32e3-4fe6-b056-fe60141157d3 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:10.711869 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0feaeb2-32e3-4fe6-b056-fe60141157d3 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:10.712560 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0feaeb2-32e3-4fe6-b056-fe60141157d3 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:10.713040 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0feaeb2-32e3-4fe6-b056-fe60141157d3 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:10.713461 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0feaeb2-32e3-4fe6-b056-fe60141157d3 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:10.838252 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d0feaeb2-32e3-4fe6-b056-fe60141157d3 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:10.845726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d0feaeb2-32e3-4fe6-b056-fe60141157d3 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1315 microversion: 2.1 time: 0.146812 Aug 26 11:05:10.846305 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 40/71] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:10 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:11.350934 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c3daf20b-6a0b-4245-97c3-573cc4f37afc tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:11.353093 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c3daf20b-6a0b-4245-97c3-573cc4f37afc tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:11.362611 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c3daf20b-6a0b-4245-97c3-573cc4f37afc tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:11.363156 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c3daf20b-6a0b-4245-97c3-573cc4f37afc tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:11.363589 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c3daf20b-6a0b-4245-97c3-573cc4f37afc tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:11.364296 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c3daf20b-6a0b-4245-97c3-573cc4f37afc tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:11.364740 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c3daf20b-6a0b-4245-97c3-573cc4f37afc tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:11.365151 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c3daf20b-6a0b-4245-97c3-573cc4f37afc tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:11.431626 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f564fc0c-9b7c-434a-968f-bee677328873 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:11.432280 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f564fc0c-9b7c-434a-968f-bee677328873 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:11.438663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f564fc0c-9b7c-434a-968f-bee677328873 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:11.439155 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f564fc0c-9b7c-434a-968f-bee677328873 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:11.439597 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f564fc0c-9b7c-434a-968f-bee677328873 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:11.440317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f564fc0c-9b7c-434a-968f-bee677328873 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:11.441054 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f564fc0c-9b7c-434a-968f-bee677328873 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:11.441484 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f564fc0c-9b7c-434a-968f-bee677328873 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:11.526863 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f564fc0c-9b7c-434a-968f-bee677328873 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:11.534844 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f564fc0c-9b7c-434a-968f-bee677328873 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:11.536365 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f564fc0c-9b7c-434a-968f-bee677328873 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:11.537599 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f564fc0c-9b7c-434a-968f-bee677328873 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1333 microversion: 2.20 time: 0.110428 Aug 26 11:05:11.538806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 41/72] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:11 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1333 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:05:11.543166 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-65186622-f8ec-4e5a-a6ff-8c8e8c842b3c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:11.543765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-65186622-f8ec-4e5a-a6ff-8c8e8c842b3c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:11.543895 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c3daf20b-6a0b-4245-97c3-573cc4f37afc tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:11.557007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c3daf20b-6a0b-4245-97c3-573cc4f37afc tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1322 microversion: 2.1 time: 0.210805 Aug 26 11:05:11.557593 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 32/73] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:11 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:11.564345 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65186622-f8ec-4e5a-a6ff-8c8e8c842b3c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:11.565116 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65186622-f8ec-4e5a-a6ff-8c8e8c842b3c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:11.565732 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65186622-f8ec-4e5a-a6ff-8c8e8c842b3c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:11.566672 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65186622-f8ec-4e5a-a6ff-8c8e8c842b3c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:11.567296 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65186622-f8ec-4e5a-a6ff-8c8e8c842b3c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:11.567962 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65186622-f8ec-4e5a-a6ff-8c8e8c842b3c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:11.654484 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-65186622-f8ec-4e5a-a6ff-8c8e8c842b3c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:11.662302 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-65186622-f8ec-4e5a-a6ff-8c8e8c842b3c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1241 microversion: 2.1 time: 0.122434 Aug 26 11:05:11.663190 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 42/74] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:11 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:11.867573 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-d6f88dd0-dbca-4d94-8f3d-da1b803915fe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:11.868105 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-d6f88dd0-dbca-4d94-8f3d-da1b803915fe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:11.879289 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d6f88dd0-dbca-4d94-8f3d-da1b803915fe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:11.879482 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d6f88dd0-dbca-4d94-8f3d-da1b803915fe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:11.879923 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d6f88dd0-dbca-4d94-8f3d-da1b803915fe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:11.880619 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d6f88dd0-dbca-4d94-8f3d-da1b803915fe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:11.881066 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d6f88dd0-dbca-4d94-8f3d-da1b803915fe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:11.882225 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d6f88dd0-dbca-4d94-8f3d-da1b803915fe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:12.025002 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-d6f88dd0-dbca-4d94-8f3d-da1b803915fe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:12.032892 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-d6f88dd0-dbca-4d94-8f3d-da1b803915fe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1315 microversion: 2.1 time: 0.169670 Aug 26 11:05:12.033466 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 33/75] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:11 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:12.563320 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d7e2b866-0b26-40b2-8747-c7e0ea995591 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:12.564759 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d7e2b866-0b26-40b2-8747-c7e0ea995591 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:12.578731 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-296f0893-80ce-48e1-bfbd-af061a7ee2e9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:12.579108 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-296f0893-80ce-48e1-bfbd-af061a7ee2e9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:12.587821 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-296f0893-80ce-48e1-bfbd-af061a7ee2e9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:12.591099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d7e2b866-0b26-40b2-8747-c7e0ea995591 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:12.591821 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-296f0893-80ce-48e1-bfbd-af061a7ee2e9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:12.594506 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-296f0893-80ce-48e1-bfbd-af061a7ee2e9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:12.594883 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d7e2b866-0b26-40b2-8747-c7e0ea995591 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:12.597083 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-296f0893-80ce-48e1-bfbd-af061a7ee2e9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:12.597729 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d7e2b866-0b26-40b2-8747-c7e0ea995591 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:12.598668 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d7e2b866-0b26-40b2-8747-c7e0ea995591 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:12.599234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-296f0893-80ce-48e1-bfbd-af061a7ee2e9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:12.600896 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-296f0893-80ce-48e1-bfbd-af061a7ee2e9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:12.602833 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d7e2b866-0b26-40b2-8747-c7e0ea995591 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:12.603297 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d7e2b866-0b26-40b2-8747-c7e0ea995591 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:12.909765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d7e2b866-0b26-40b2-8747-c7e0ea995591 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:12.918557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d7e2b866-0b26-40b2-8747-c7e0ea995591 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:12.920007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d7e2b866-0b26-40b2-8747-c7e0ea995591 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:12.924804 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d7e2b866-0b26-40b2-8747-c7e0ea995591 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1341 microversion: 2.20 time: 0.366638 Aug 26 11:05:12.925221 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 43/76] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:12 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1341 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:12.937784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-42ba71d3-4a85-4f43-b46b-f079f6a5338e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:12.938691 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-42ba71d3-4a85-4f43-b46b-f079f6a5338e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:12.947821 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-42ba71d3-4a85-4f43-b46b-f079f6a5338e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:12.948573 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-42ba71d3-4a85-4f43-b46b-f079f6a5338e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:12.949006 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-42ba71d3-4a85-4f43-b46b-f079f6a5338e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:12.949908 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-42ba71d3-4a85-4f43-b46b-f079f6a5338e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:12.950787 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-42ba71d3-4a85-4f43-b46b-f079f6a5338e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:12.951416 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-42ba71d3-4a85-4f43-b46b-f079f6a5338e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:13.036183 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-42ba71d3-4a85-4f43-b46b-f079f6a5338e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:13.048452 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-42ba71d3-4a85-4f43-b46b-f079f6a5338e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1233 microversion: 2.1 time: 0.120930 Aug 26 11:05:13.050240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 44/77] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:12 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1233 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:13.067247 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-296f0893-80ce-48e1-bfbd-af061a7ee2e9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:13.067861 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1f52dbd6-47a4-4db4-83e8-512440c4c9db tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:13.068360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1f52dbd6-47a4-4db4-83e8-512440c4c9db tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:13.075534 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=75 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:13.075840 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f52dbd6-47a4-4db4-83e8-512440c4c9db tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:13.076642 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f52dbd6-47a4-4db4-83e8-512440c4c9db tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:13.077130 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f52dbd6-47a4-4db4-83e8-512440c4c9db tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:13.078053 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f52dbd6-47a4-4db4-83e8-512440c4c9db tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:13.078679 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f52dbd6-47a4-4db4-83e8-512440c4c9db tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:13.079208 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-296f0893-80ce-48e1-bfbd-af061a7ee2e9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1322 microversion: 2.1 time: 0.504852 Aug 26 11:05:13.079351 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f52dbd6-47a4-4db4-83e8-512440c4c9db tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:13.080536 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 34/78] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:12 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:05:13.230380 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1f52dbd6-47a4-4db4-83e8-512440c4c9db tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:13.238099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1f52dbd6-47a4-4db4-83e8-512440c4c9db tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1315 microversion: 2.1 time: 0.186623 Aug 26 11:05:13.238972 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 45/79] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:13 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:13.952429 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-069161ea-698f-4cff-914c-c00ae78a6d9b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:13.953705 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-069161ea-698f-4cff-914c-c00ae78a6d9b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:13.956282 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:13.965677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-069161ea-698f-4cff-914c-c00ae78a6d9b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:13.966509 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-069161ea-698f-4cff-914c-c00ae78a6d9b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:13.967210 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-069161ea-698f-4cff-914c-c00ae78a6d9b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:13.968513 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-069161ea-698f-4cff-914c-c00ae78a6d9b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:13.969112 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-069161ea-698f-4cff-914c-c00ae78a6d9b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:13.969874 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-069161ea-698f-4cff-914c-c00ae78a6d9b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:14.070946 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-810d4063-cc82-4185-867f-dfca5b517b4d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:14.071749 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-810d4063-cc82-4185-867f-dfca5b517b4d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:14.078520 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-810d4063-cc82-4185-867f-dfca5b517b4d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:14.079321 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-810d4063-cc82-4185-867f-dfca5b517b4d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:14.080009 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-810d4063-cc82-4185-867f-dfca5b517b4d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:14.080923 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-810d4063-cc82-4185-867f-dfca5b517b4d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:14.081802 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-810d4063-cc82-4185-867f-dfca5b517b4d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:14.083048 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-810d4063-cc82-4185-867f-dfca5b517b4d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:14.086990 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-069161ea-698f-4cff-914c-c00ae78a6d9b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:14.107511 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-069161ea-698f-4cff-914c-c00ae78a6d9b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:14.109429 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-069161ea-698f-4cff-914c-c00ae78a6d9b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:14.111835 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-069161ea-698f-4cff-914c-c00ae78a6d9b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1339 microversion: 2.20 time: 0.164897 Aug 26 11:05:14.118728 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 35/80] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:13 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1339 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:14.145153 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a7840501-2228-4aa5-877a-8786eda95562 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:14.146734 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-a7840501-2228-4aa5-877a-8786eda95562 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:14.157080 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a7840501-2228-4aa5-877a-8786eda95562 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:14.158310 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a7840501-2228-4aa5-877a-8786eda95562 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:14.158986 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a7840501-2228-4aa5-877a-8786eda95562 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:14.160357 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a7840501-2228-4aa5-877a-8786eda95562 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:14.161107 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a7840501-2228-4aa5-877a-8786eda95562 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:14.161916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a7840501-2228-4aa5-877a-8786eda95562 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:14.172125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-810d4063-cc82-4185-867f-dfca5b517b4d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:14.180919 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-810d4063-cc82-4185-867f-dfca5b517b4d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1289 microversion: 2.1 time: 0.113832 Aug 26 11:05:14.182365 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 46/81] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:14 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1289 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:14.260342 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-216be5d7-c6c5-4098-a29e-3b9f6132217c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:14.260890 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-216be5d7-c6c5-4098-a29e-3b9f6132217c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:14.267032 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-216be5d7-c6c5-4098-a29e-3b9f6132217c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:14.267520 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-216be5d7-c6c5-4098-a29e-3b9f6132217c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:14.267957 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-216be5d7-c6c5-4098-a29e-3b9f6132217c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:14.268661 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-216be5d7-c6c5-4098-a29e-3b9f6132217c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:14.269145 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-216be5d7-c6c5-4098-a29e-3b9f6132217c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:14.269568 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-216be5d7-c6c5-4098-a29e-3b9f6132217c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:14.318849 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-a7840501-2228-4aa5-877a-8786eda95562 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:14.326682 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-a7840501-2228-4aa5-877a-8786eda95562 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1322 microversion: 2.1 time: 0.206644 Aug 26 11:05:14.328546 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 36/82] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:14 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:14.434254 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-216be5d7-c6c5-4098-a29e-3b9f6132217c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:14.440715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-216be5d7-c6c5-4098-a29e-3b9f6132217c tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1315 microversion: 2.1 time: 0.184293 Aug 26 11:05:14.441325 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 47/83] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:14 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:15.136575 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-ce7c3dde-c7fa-4d86-8731-ad9f599934de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:15.137181 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-ce7c3dde-c7fa-4d86-8731-ad9f599934de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:15.148413 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ce7c3dde-c7fa-4d86-8731-ad9f599934de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:15.148912 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ce7c3dde-c7fa-4d86-8731-ad9f599934de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:15.154489 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ce7c3dde-c7fa-4d86-8731-ad9f599934de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:15.155226 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ce7c3dde-c7fa-4d86-8731-ad9f599934de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:15.155694 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ce7c3dde-c7fa-4d86-8731-ad9f599934de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:15.156174 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ce7c3dde-c7fa-4d86-8731-ad9f599934de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:15.205635 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d5806e1c-f8b5-4d69-836b-b5e255af06da tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:15.207618 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d5806e1c-f8b5-4d69-836b-b5e255af06da tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:15.223457 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5806e1c-f8b5-4d69-836b-b5e255af06da tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:15.223951 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5806e1c-f8b5-4d69-836b-b5e255af06da tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:15.224390 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5806e1c-f8b5-4d69-836b-b5e255af06da tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:15.226097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5806e1c-f8b5-4d69-836b-b5e255af06da tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:15.226599 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5806e1c-f8b5-4d69-836b-b5e255af06da tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:15.227028 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5806e1c-f8b5-4d69-836b-b5e255af06da tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:15.274411 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-ce7c3dde-c7fa-4d86-8731-ad9f599934de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:15.291860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-ce7c3dde-c7fa-4d86-8731-ad9f599934de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:15.294156 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-ce7c3dde-c7fa-4d86-8731-ad9f599934de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:15.295965 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-ce7c3dde-c7fa-4d86-8731-ad9f599934de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1339 microversion: 2.20 time: 0.163112 Aug 26 11:05:15.310441 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 37/84] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:15 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1339 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:05:15.336386 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d5806e1c-f8b5-4d69-836b-b5e255af06da tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:15.348691 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-649cce7f-cdcd-4ece-a230-7d2c71f75dc3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:15.349303 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-649cce7f-cdcd-4ece-a230-7d2c71f75dc3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:15.349452 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d5806e1c-f8b5-4d69-836b-b5e255af06da tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1289 microversion: 2.1 time: 0.150240 Aug 26 11:05:15.358009 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 48/85] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:15 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1289 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:05:15.363011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-649cce7f-cdcd-4ece-a230-7d2c71f75dc3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:15.363011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-649cce7f-cdcd-4ece-a230-7d2c71f75dc3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:15.363011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-649cce7f-cdcd-4ece-a230-7d2c71f75dc3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:15.363011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-649cce7f-cdcd-4ece-a230-7d2c71f75dc3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:15.363384 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-649cce7f-cdcd-4ece-a230-7d2c71f75dc3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:15.363466 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-649cce7f-cdcd-4ece-a230-7d2c71f75dc3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:15.461122 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-16c80517-b1d9-4d4d-aabc-43d12f6aa5c5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:15.461744 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-16c80517-b1d9-4d4d-aabc-43d12f6aa5c5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:15.472488 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16c80517-b1d9-4d4d-aabc-43d12f6aa5c5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:15.474592 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16c80517-b1d9-4d4d-aabc-43d12f6aa5c5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:15.475760 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16c80517-b1d9-4d4d-aabc-43d12f6aa5c5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:15.481524 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16c80517-b1d9-4d4d-aabc-43d12f6aa5c5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:15.482353 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16c80517-b1d9-4d4d-aabc-43d12f6aa5c5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:15.483048 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16c80517-b1d9-4d4d-aabc-43d12f6aa5c5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:15.990957 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-649cce7f-cdcd-4ece-a230-7d2c71f75dc3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:16.007081 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-649cce7f-cdcd-4ece-a230-7d2c71f75dc3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1322 microversion: 2.1 time: 0.661434 Aug 26 11:05:16.007988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 38/86] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:15 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1322 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:05:16.201726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-16c80517-b1d9-4d4d-aabc-43d12f6aa5c5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:16.214577 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-16c80517-b1d9-4d4d-aabc-43d12f6aa5c5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1315 microversion: 2.1 time: 0.753530 Aug 26 11:05:16.229669 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 49/87] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:15 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1315 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:16.324423 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a18164d5-6700-4116-aba4-a7fa773c7f98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:16.325045 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-a18164d5-6700-4116-aba4-a7fa773c7f98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:16.336154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a18164d5-6700-4116-aba4-a7fa773c7f98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:16.336950 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a18164d5-6700-4116-aba4-a7fa773c7f98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:16.337695 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a18164d5-6700-4116-aba4-a7fa773c7f98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:16.338630 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a18164d5-6700-4116-aba4-a7fa773c7f98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:16.340484 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a18164d5-6700-4116-aba4-a7fa773c7f98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:16.342419 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a18164d5-6700-4116-aba4-a7fa773c7f98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:16.374102 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6dcfb65d-89c3-4d0a-b393-04b9121feadf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:16.375026 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6dcfb65d-89c3-4d0a-b393-04b9121feadf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:16.390174 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6dcfb65d-89c3-4d0a-b393-04b9121feadf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:16.392686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6dcfb65d-89c3-4d0a-b393-04b9121feadf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:16.395492 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6dcfb65d-89c3-4d0a-b393-04b9121feadf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:16.400368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6dcfb65d-89c3-4d0a-b393-04b9121feadf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:16.402714 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6dcfb65d-89c3-4d0a-b393-04b9121feadf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:16.403228 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6dcfb65d-89c3-4d0a-b393-04b9121feadf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:16.568324 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-a18164d5-6700-4116-aba4-a7fa773c7f98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:16.582056 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-a18164d5-6700-4116-aba4-a7fa773c7f98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:16.591755 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-a18164d5-6700-4116-aba4-a7fa773c7f98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:16.594402 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-a18164d5-6700-4116-aba4-a7fa773c7f98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1339 microversion: 2.20 time: 0.273652 Aug 26 11:05:16.597178 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 39/88] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:16 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1339 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:16.625106 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6dcfb65d-89c3-4d0a-b393-04b9121feadf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:16.638363 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6dcfb65d-89c3-4d0a-b393-04b9121feadf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1295 microversion: 2.1 time: 0.265438 Aug 26 11:05:16.639969 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 50/89] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:16 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1295 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:05:17.043865 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1cce3078-a749-4f80-880d-116029aaf5c9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:17.044898 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-1cce3078-a749-4f80-880d-116029aaf5c9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:17.061732 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1cce3078-a749-4f80-880d-116029aaf5c9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:17.064352 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1cce3078-a749-4f80-880d-116029aaf5c9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:17.071810 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1cce3078-a749-4f80-880d-116029aaf5c9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:17.072703 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1cce3078-a749-4f80-880d-116029aaf5c9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:17.073288 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1cce3078-a749-4f80-880d-116029aaf5c9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:17.073789 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1cce3078-a749-4f80-880d-116029aaf5c9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:17.242093 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3599bad1-35df-4379-ab92-17e7651c8c20 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:17.244776 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3599bad1-35df-4379-ab92-17e7651c8c20 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:17.252470 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:17.255992 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3599bad1-35df-4379-ab92-17e7651c8c20 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:17.259593 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3599bad1-35df-4379-ab92-17e7651c8c20 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:17.268665 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3599bad1-35df-4379-ab92-17e7651c8c20 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:17.272525 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3599bad1-35df-4379-ab92-17e7651c8c20 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:17.273044 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3599bad1-35df-4379-ab92-17e7651c8c20 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:17.273722 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3599bad1-35df-4379-ab92-17e7651c8c20 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:17.513451 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1cce3078-a749-4f80-880d-116029aaf5c9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:17.524311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1cce3078-a749-4f80-880d-116029aaf5c9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1322 microversion: 2.1 time: 0.483645 Aug 26 11:05:17.525342 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 40/90] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:17 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1322 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:17.534432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:17.619761 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c51e8ad1-ebf5-4bc9-94d2-f5dea484821a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:17.621088 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c51e8ad1-ebf5-4bc9-94d2-f5dea484821a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:17.645570 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c51e8ad1-ebf5-4bc9-94d2-f5dea484821a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:17.647122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c51e8ad1-ebf5-4bc9-94d2-f5dea484821a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:17.647618 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c51e8ad1-ebf5-4bc9-94d2-f5dea484821a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:17.648796 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c51e8ad1-ebf5-4bc9-94d2-f5dea484821a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:17.649276 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c51e8ad1-ebf5-4bc9-94d2-f5dea484821a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:17.649709 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c51e8ad1-ebf5-4bc9-94d2-f5dea484821a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:17.774652 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3599bad1-35df-4379-ab92-17e7651c8c20 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:17.790048 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3599bad1-35df-4379-ab92-17e7651c8c20 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1315 microversion: 2.1 time: 0.554780 Aug 26 11:05:17.792151 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 51/91] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:17 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:17.808329 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-88c4d6b6-ecea-4b63-a79e-13549759188d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:17.809609 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-88c4d6b6-ecea-4b63-a79e-13549759188d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:17.829074 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88c4d6b6-ecea-4b63-a79e-13549759188d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:17.830058 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88c4d6b6-ecea-4b63-a79e-13549759188d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:17.833524 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88c4d6b6-ecea-4b63-a79e-13549759188d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:17.839388 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88c4d6b6-ecea-4b63-a79e-13549759188d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:17.842317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88c4d6b6-ecea-4b63-a79e-13549759188d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:17.843821 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88c4d6b6-ecea-4b63-a79e-13549759188d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:18.373557 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c51e8ad1-ebf5-4bc9-94d2-f5dea484821a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:18.385233 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c51e8ad1-ebf5-4bc9-94d2-f5dea484821a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:18.389052 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c51e8ad1-ebf5-4bc9-94d2-f5dea484821a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:18.392703 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c51e8ad1-ebf5-4bc9-94d2-f5dea484821a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.777948 Aug 26 11:05:18.398177 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 41/92] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:17 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:05:18.480251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-88c4d6b6-ecea-4b63-a79e-13549759188d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:18.490443 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-88c4d6b6-ecea-4b63-a79e-13549759188d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.696059 Aug 26 11:05:18.492614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 52/93] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:17 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:18.546013 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5f347766-dde3-4a92-baf5-7e7b5e0ed4ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:18.546530 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5f347766-dde3-4a92-baf5-7e7b5e0ed4ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:18.561593 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5f347766-dde3-4a92-baf5-7e7b5e0ed4ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:18.562124 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5f347766-dde3-4a92-baf5-7e7b5e0ed4ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:18.562438 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5f347766-dde3-4a92-baf5-7e7b5e0ed4ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:18.563142 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5f347766-dde3-4a92-baf5-7e7b5e0ed4ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:18.563577 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5f347766-dde3-4a92-baf5-7e7b5e0ed4ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:18.563994 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5f347766-dde3-4a92-baf5-7e7b5e0ed4ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:18.813622 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-53cd125a-0f0b-4639-835c-7d01103ae7da tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:18.814549 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-53cd125a-0f0b-4639-835c-7d01103ae7da tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:18.826548 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53cd125a-0f0b-4639-835c-7d01103ae7da tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:18.827428 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53cd125a-0f0b-4639-835c-7d01103ae7da tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:18.828149 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53cd125a-0f0b-4639-835c-7d01103ae7da tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:18.829360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53cd125a-0f0b-4639-835c-7d01103ae7da tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:18.830227 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53cd125a-0f0b-4639-835c-7d01103ae7da tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:18.831053 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53cd125a-0f0b-4639-835c-7d01103ae7da tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:19.148325 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5f347766-dde3-4a92-baf5-7e7b5e0ed4ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:19.167881 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5f347766-dde3-4a92-baf5-7e7b5e0ed4ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1322 microversion: 2.1 time: 0.624912 Aug 26 11:05:19.170398 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 42/94] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:18 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1322 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:19.188142 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-f5a66f07-f6d2-43f5-9147-4447e18cfb62 req-9047d938-a73f-4fe3-a7e1-c1576a799937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01ae91d9-0521-4d14-b2b6-e56f249c4181", "tag": "36a4faa3-3a22-4156-8542-c0c5ea7e7f1c"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:19.222481 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f5a66f07-f6d2-43f5-9147-4447e18cfb62 req-9047d938-a73f-4fe3-a7e1-c1576a799937 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:19.224977 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f5a66f07-f6d2-43f5-9147-4447e18cfb62 req-9047d938-a73f-4fe3-a7e1-c1576a799937 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:19.225561 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f5a66f07-f6d2-43f5-9147-4447e18cfb62 req-9047d938-a73f-4fe3-a7e1-c1576a799937 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:19.235591 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=6 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:19.263314 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-f5a66f07-f6d2-43f5-9147-4447e18cfb62 req-9047d938-a73f-4fe3-a7e1-c1576a799937 service nova] Creating event network-changed:36a4faa3-3a22-4156-8542-c0c5ea7e7f1c for instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 on hv-cinder-85236 Aug 26 11:05:19.278913 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-f5a66f07-f6d2-43f5-9147-4447e18cfb62 req-9047d938-a73f-4fe3-a7e1-c1576a799937 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103555 Aug 26 11:05:19.282156 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 43/95] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:05:19.325661 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-53cd125a-0f0b-4639-835c-7d01103ae7da tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:19.341565 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-53cd125a-0f0b-4639-835c-7d01103ae7da tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1315 microversion: 2.1 time: 0.533374 Aug 26 11:05:19.342647 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 53/96] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:18 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:05:19.415439 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=14 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:19.421196 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f66f5434-bcae-4937-b63d-69cb51f12602 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:19.421920 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f66f5434-bcae-4937-b63d-69cb51f12602 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:19.441798 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f66f5434-bcae-4937-b63d-69cb51f12602 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:19.442473 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f66f5434-bcae-4937-b63d-69cb51f12602 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:19.442926 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f66f5434-bcae-4937-b63d-69cb51f12602 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:19.445173 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f66f5434-bcae-4937-b63d-69cb51f12602 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:19.447338 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f66f5434-bcae-4937-b63d-69cb51f12602 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:19.447965 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f66f5434-bcae-4937-b63d-69cb51f12602 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:19.514299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3dbd9480-e49c-4a3c-8f48-d1e18ec7dab7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:19.515067 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3dbd9480-e49c-4a3c-8f48-d1e18ec7dab7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:19.530942 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3dbd9480-e49c-4a3c-8f48-d1e18ec7dab7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:19.531625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3dbd9480-e49c-4a3c-8f48-d1e18ec7dab7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:19.532214 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3dbd9480-e49c-4a3c-8f48-d1e18ec7dab7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:19.533079 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3dbd9480-e49c-4a3c-8f48-d1e18ec7dab7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:19.534194 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3dbd9480-e49c-4a3c-8f48-d1e18ec7dab7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:19.534803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3dbd9480-e49c-4a3c-8f48-d1e18ec7dab7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:20.008725 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3dbd9480-e49c-4a3c-8f48-d1e18ec7dab7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:20.023654 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3dbd9480-e49c-4a3c-8f48-d1e18ec7dab7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.512871 Aug 26 11:05:20.024498 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 54/97] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:19 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:05:20.065350 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f66f5434-bcae-4937-b63d-69cb51f12602 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:20.076882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f66f5434-bcae-4937-b63d-69cb51f12602 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:20.078587 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f66f5434-bcae-4937-b63d-69cb51f12602 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:20.079713 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f66f5434-bcae-4937-b63d-69cb51f12602 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.667787 Aug 26 11:05:20.086812 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 44/98] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:19 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:20.189586 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-1df86a6d-c471-4614-9bac-a5403cf2e383 req-cff0af74-c71c-474f-a5e6-32181aa45ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcad555f-f60b-409e-9075-f4fcdbbba3fe", "tag": "65e305ab-f815-483f-8ea8-1d853476bc95"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:20.212781 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-1df86a6d-c471-4614-9bac-a5403cf2e383 req-cff0af74-c71c-474f-a5e6-32181aa45ab9 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:20.213411 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-1df86a6d-c471-4614-9bac-a5403cf2e383 req-cff0af74-c71c-474f-a5e6-32181aa45ab9 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:20.214443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-1df86a6d-c471-4614-9bac-a5403cf2e383 req-cff0af74-c71c-474f-a5e6-32181aa45ab9 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:20.242768 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-1df86a6d-c471-4614-9bac-a5403cf2e383 req-cff0af74-c71c-474f-a5e6-32181aa45ab9 service nova] Creating event network-changed:65e305ab-f815-483f-8ea8-1d853476bc95 for instance fcad555f-f60b-409e-9075-f4fcdbbba3fe on hv-cinder-85236 Aug 26 11:05:20.262344 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-1df86a6d-c471-4614-9bac-a5403cf2e383 req-cff0af74-c71c-474f-a5e6-32181aa45ab9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076185 Aug 26 11:05:20.264837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 45/99] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:05:20.272779 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-87391cb3-c113-4fbe-afde-91d5c2308d38 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:20.273793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-87391cb3-c113-4fbe-afde-91d5c2308d38 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:20.280803 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-87391cb3-c113-4fbe-afde-91d5c2308d38 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:20.282458 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-87391cb3-c113-4fbe-afde-91d5c2308d38 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:20.283065 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-87391cb3-c113-4fbe-afde-91d5c2308d38 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:20.283900 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-87391cb3-c113-4fbe-afde-91d5c2308d38 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:20.284362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-87391cb3-c113-4fbe-afde-91d5c2308d38 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:20.284837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-87391cb3-c113-4fbe-afde-91d5c2308d38 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:20.441559 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-7b873faa-6deb-4d73-bae5-1bc5647980c9 req-5c4aa71e-5bfb-4f7e-8f98-6ea964291820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78ce714-fb3b-4478-9d40-7e298961441e", "name": "network-vif-plugged", "status": "completed", "tag": "57c9d59f-1551-4d0a-834b-3fb18f12f22f"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:20.467907 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-7b873faa-6deb-4d73-bae5-1bc5647980c9 req-5c4aa71e-5bfb-4f7e-8f98-6ea964291820 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:20.468355 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-7b873faa-6deb-4d73-bae5-1bc5647980c9 req-5c4aa71e-5bfb-4f7e-8f98-6ea964291820 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:20.470914 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-7b873faa-6deb-4d73-bae5-1bc5647980c9 req-5c4aa71e-5bfb-4f7e-8f98-6ea964291820 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:20.507531 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-7b873faa-6deb-4d73-bae5-1bc5647980c9 req-5c4aa71e-5bfb-4f7e-8f98-6ea964291820 service nova] Creating event network-vif-plugged:57c9d59f-1551-4d0a-834b-3fb18f12f22f for instance b78ce714-fb3b-4478-9d40-7e298961441e on hv-cinder-85236 Aug 26 11:05:20.518556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-7b873faa-6deb-4d73-bae5-1bc5647980c9 req-5c4aa71e-5bfb-4f7e-8f98-6ea964291820 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.490692 Aug 26 11:05:20.521116 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 55/100] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:05:20.560781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1506e912-38f4-4e3a-92bc-e8f648f6e4a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:20.562234 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1506e912-38f4-4e3a-92bc-e8f648f6e4a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:20.574903 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1506e912-38f4-4e3a-92bc-e8f648f6e4a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:20.575396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1506e912-38f4-4e3a-92bc-e8f648f6e4a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:20.575924 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1506e912-38f4-4e3a-92bc-e8f648f6e4a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:20.586892 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1506e912-38f4-4e3a-92bc-e8f648f6e4a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:20.590050 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1506e912-38f4-4e3a-92bc-e8f648f6e4a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:20.590738 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1506e912-38f4-4e3a-92bc-e8f648f6e4a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:20.675094 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-87391cb3-c113-4fbe-afde-91d5c2308d38 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:20.689273 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-87391cb3-c113-4fbe-afde-91d5c2308d38 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1322 microversion: 2.1 time: 0.423025 Aug 26 11:05:20.694459 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 46/101] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:20 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1322 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:21.049719 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1f792c57-5319-4efa-82be-351356833e9c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:21.050378 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-1f792c57-5319-4efa-82be-351356833e9c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:21.070303 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1f792c57-5319-4efa-82be-351356833e9c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:21.075756 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1f792c57-5319-4efa-82be-351356833e9c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:21.080423 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1f792c57-5319-4efa-82be-351356833e9c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:21.081445 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1f792c57-5319-4efa-82be-351356833e9c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:21.082285 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1f792c57-5319-4efa-82be-351356833e9c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:21.082857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1f792c57-5319-4efa-82be-351356833e9c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:21.513880 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1506e912-38f4-4e3a-92bc-e8f648f6e4a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:21.526318 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1506e912-38f4-4e3a-92bc-e8f648f6e4a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1315 microversion: 2.1 time: 1.002500 Aug 26 11:05:21.529525 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 56/102] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:20 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1315 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:21.541669 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-dd6b3b7e-3bfd-4c16-a569-28a5bf501881 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:21.542762 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-dd6b3b7e-3bfd-4c16-a569-28a5bf501881 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:21.559105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd6b3b7e-3bfd-4c16-a569-28a5bf501881 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:21.561304 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd6b3b7e-3bfd-4c16-a569-28a5bf501881 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:21.562005 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd6b3b7e-3bfd-4c16-a569-28a5bf501881 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:21.563672 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd6b3b7e-3bfd-4c16-a569-28a5bf501881 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:21.566652 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd6b3b7e-3bfd-4c16-a569-28a5bf501881 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:21.568221 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd6b3b7e-3bfd-4c16-a569-28a5bf501881 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:21.625807 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=100 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:21.817595 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1f792c57-5319-4efa-82be-351356833e9c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:21.828483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1f792c57-5319-4efa-82be-351356833e9c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.784746 Aug 26 11:05:21.829274 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 47/103] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:21 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:05:21.836282 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-e636379d-3e69-498e-be65-0bf884c2052c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:21.837126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e636379d-3e69-498e-be65-0bf884c2052c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:21.846893 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e636379d-3e69-498e-be65-0bf884c2052c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:21.847616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e636379d-3e69-498e-be65-0bf884c2052c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:21.848246 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e636379d-3e69-498e-be65-0bf884c2052c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:21.849292 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e636379d-3e69-498e-be65-0bf884c2052c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:21.854997 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e636379d-3e69-498e-be65-0bf884c2052c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:21.855527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e636379d-3e69-498e-be65-0bf884c2052c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:21.864362 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-dd6b3b7e-3bfd-4c16-a569-28a5bf501881 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:21.880675 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-dd6b3b7e-3bfd-4c16-a569-28a5bf501881 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:21.887270 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-dd6b3b7e-3bfd-4c16-a569-28a5bf501881 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:21.899029 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-dd6b3b7e-3bfd-4c16-a569-28a5bf501881 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.367145 Aug 26 11:05:21.899626 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 57/104] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:21 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:22.331463 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-e636379d-3e69-498e-be65-0bf884c2052c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:22.341217 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-e636379d-3e69-498e-be65-0bf884c2052c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1322 microversion: 2.1 time: 0.510096 Aug 26 11:05:22.342013 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 48/105] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:21 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1322 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:22.535695 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-e619fe0a-b020-49ae-a278-f361612b6d19 req-5581360c-e343-48f7-8d39-af8a54fff6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04076a90-f7d2-4295-a167-5eab08bfdf37", "name": "network-vif-plugged", "status": "completed", "tag": "25f6fa0a-7f42-4b62-acf1-e6c9ee0ad2ad"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:22.554644 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b2df4f63-c55e-4ad6-96a5-6981ffcf0fd5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:22.555295 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b2df4f63-c55e-4ad6-96a5-6981ffcf0fd5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:22.563404 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e619fe0a-b020-49ae-a278-f361612b6d19 req-5581360c-e343-48f7-8d39-af8a54fff6af service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:22.563613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2df4f63-c55e-4ad6-96a5-6981ffcf0fd5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:22.564115 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2df4f63-c55e-4ad6-96a5-6981ffcf0fd5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:22.564544 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2df4f63-c55e-4ad6-96a5-6981ffcf0fd5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:22.565244 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2df4f63-c55e-4ad6-96a5-6981ffcf0fd5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:22.565522 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e619fe0a-b020-49ae-a278-f361612b6d19 req-5581360c-e343-48f7-8d39-af8a54fff6af service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:22.566102 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e619fe0a-b020-49ae-a278-f361612b6d19 req-5581360c-e343-48f7-8d39-af8a54fff6af service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:22.570305 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2df4f63-c55e-4ad6-96a5-6981ffcf0fd5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:22.570978 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2df4f63-c55e-4ad6-96a5-6981ffcf0fd5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:22.602357 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-e619fe0a-b020-49ae-a278-f361612b6d19 req-5581360c-e343-48f7-8d39-af8a54fff6af service nova] Creating event network-vif-plugged:25f6fa0a-7f42-4b62-acf1-e6c9ee0ad2ad for instance 04076a90-f7d2-4295-a167-5eab08bfdf37 on hv-cinder-85236 Aug 26 11:05:22.616575 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-e619fe0a-b020-49ae-a278-f361612b6d19 req-5581360c-e343-48f7-8d39-af8a54fff6af service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084098 Aug 26 11:05:22.620472 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 58/106] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:05:22.850657 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1411f1ad-03ee-4c2a-bd7e-c7dd4a5d3191 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:22.851471 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1411f1ad-03ee-4c2a-bd7e-c7dd4a5d3191 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:22.865045 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1411f1ad-03ee-4c2a-bd7e-c7dd4a5d3191 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:22.871362 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1411f1ad-03ee-4c2a-bd7e-c7dd4a5d3191 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:22.873807 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1411f1ad-03ee-4c2a-bd7e-c7dd4a5d3191 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:22.874149 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1411f1ad-03ee-4c2a-bd7e-c7dd4a5d3191 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:22.874669 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1411f1ad-03ee-4c2a-bd7e-c7dd4a5d3191 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:22.875135 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1411f1ad-03ee-4c2a-bd7e-c7dd4a5d3191 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:22.898022 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b2df4f63-c55e-4ad6-96a5-6981ffcf0fd5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:22.911029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b2df4f63-c55e-4ad6-96a5-6981ffcf0fd5 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1315 microversion: 2.1 time: 0.361898 Aug 26 11:05:22.914419 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 49/107] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:22 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:22.924250 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-8c7c3220-361a-451e-983e-d3cdcd4bf0b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:22.926183 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-8c7c3220-361a-451e-983e-d3cdcd4bf0b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:22.938577 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8c7c3220-361a-451e-983e-d3cdcd4bf0b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:22.939107 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8c7c3220-361a-451e-983e-d3cdcd4bf0b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:22.939538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8c7c3220-361a-451e-983e-d3cdcd4bf0b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:22.940261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8c7c3220-361a-451e-983e-d3cdcd4bf0b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:22.942775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8c7c3220-361a-451e-983e-d3cdcd4bf0b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:22.943501 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8c7c3220-361a-451e-983e-d3cdcd4bf0b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:23.239871 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8c7c3220-361a-451e-983e-d3cdcd4bf0b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:23.251805 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8c7c3220-361a-451e-983e-d3cdcd4bf0b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:23.254913 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8c7c3220-361a-451e-983e-d3cdcd4bf0b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:23.257319 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-8c7c3220-361a-451e-983e-d3cdcd4bf0b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.338269 Aug 26 11:05:23.258205 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 50/108] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:22 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:23.260935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1411f1ad-03ee-4c2a-bd7e-c7dd4a5d3191 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:23.291547 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1411f1ad-03ee-4c2a-bd7e-c7dd4a5d3191 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.445733 Aug 26 11:05:23.292164 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 59/109] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:22 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:05:23.368145 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-770a589a-7254-437e-8eea-c437d650213b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:23.368771 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-770a589a-7254-437e-8eea-c437d650213b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:23.377809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-770a589a-7254-437e-8eea-c437d650213b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:23.379214 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-770a589a-7254-437e-8eea-c437d650213b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:23.379664 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-770a589a-7254-437e-8eea-c437d650213b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:23.380377 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-770a589a-7254-437e-8eea-c437d650213b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:23.380839 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-770a589a-7254-437e-8eea-c437d650213b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:23.381822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-770a589a-7254-437e-8eea-c437d650213b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:23.558541 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-770a589a-7254-437e-8eea-c437d650213b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:23.568842 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-770a589a-7254-437e-8eea-c437d650213b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1322 microversion: 2.1 time: 0.209300 Aug 26 11:05:23.570175 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 51/110] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:23 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:23.932865 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e7f36fda-4ec7-42d6-8122-587ecc34c025 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:23.933476 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e7f36fda-4ec7-42d6-8122-587ecc34c025 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:23.940334 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e7f36fda-4ec7-42d6-8122-587ecc34c025 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:23.941038 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e7f36fda-4ec7-42d6-8122-587ecc34c025 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:23.942413 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e7f36fda-4ec7-42d6-8122-587ecc34c025 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:23.943443 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e7f36fda-4ec7-42d6-8122-587ecc34c025 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:23.945424 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e7f36fda-4ec7-42d6-8122-587ecc34c025 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:23.946051 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e7f36fda-4ec7-42d6-8122-587ecc34c025 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:24.098176 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e7f36fda-4ec7-42d6-8122-587ecc34c025 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:24.108664 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e7f36fda-4ec7-42d6-8122-587ecc34c025 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1315 microversion: 2.1 time: 0.180507 Aug 26 11:05:24.109230 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 60/111] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:23 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:24.280790 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-afd949af-d037-421d-a54c-fff6294fb5a0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:24.281358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-afd949af-d037-421d-a54c-fff6294fb5a0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:24.289123 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-afd949af-d037-421d-a54c-fff6294fb5a0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:24.289939 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-afd949af-d037-421d-a54c-fff6294fb5a0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:24.290565 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-afd949af-d037-421d-a54c-fff6294fb5a0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:24.291425 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-afd949af-d037-421d-a54c-fff6294fb5a0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:24.292032 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-afd949af-d037-421d-a54c-fff6294fb5a0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:24.292605 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-afd949af-d037-421d-a54c-fff6294fb5a0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:24.319503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9d5025ec-353e-4cfa-8885-f3d21ff288df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:24.320865 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9d5025ec-353e-4cfa-8885-f3d21ff288df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:24.332201 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d5025ec-353e-4cfa-8885-f3d21ff288df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:24.333081 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d5025ec-353e-4cfa-8885-f3d21ff288df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:24.333634 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d5025ec-353e-4cfa-8885-f3d21ff288df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:24.339400 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d5025ec-353e-4cfa-8885-f3d21ff288df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:24.344524 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d5025ec-353e-4cfa-8885-f3d21ff288df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:24.350812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d5025ec-353e-4cfa-8885-f3d21ff288df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:24.609223 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-afd949af-d037-421d-a54c-fff6294fb5a0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:24.611558 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=100 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:24.629876 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-afd949af-d037-421d-a54c-fff6294fb5a0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:24.631509 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-afd949af-d037-421d-a54c-fff6294fb5a0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:24.634571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-afd949af-d037-421d-a54c-fff6294fb5a0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.357811 Aug 26 11:05:24.635295 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 52/112] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:24 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:24.650547 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5395d3f3-3cef-48d7-96d5-7818a6623d57 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:24.652318 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5395d3f3-3cef-48d7-96d5-7818a6623d57 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:24.658532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5395d3f3-3cef-48d7-96d5-7818a6623d57 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:24.659228 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5395d3f3-3cef-48d7-96d5-7818a6623d57 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:24.659928 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5395d3f3-3cef-48d7-96d5-7818a6623d57 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:24.661040 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5395d3f3-3cef-48d7-96d5-7818a6623d57 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:24.661674 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5395d3f3-3cef-48d7-96d5-7818a6623d57 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:24.662870 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5395d3f3-3cef-48d7-96d5-7818a6623d57 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:24.664220 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9d5025ec-353e-4cfa-8885-f3d21ff288df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:24.673291 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9d5025ec-353e-4cfa-8885-f3d21ff288df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.359992 Aug 26 11:05:24.674542 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 61/113] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:24 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:05:24.679614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-6a14faa9-c4aa-462d-ac8b-b5852fea0dcb req-14e55e9b-05a9-40b7-9b00-08c48f786bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc3934b-d598-47c2-9fcb-404b2fe5a478", "name": "network-vif-plugged", "status": "completed", "tag": "e09f28fa-7224-41d2-b9f8-5ce2b96f6acc"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:24.689375 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-6a14faa9-c4aa-462d-ac8b-b5852fea0dcb req-14e55e9b-05a9-40b7-9b00-08c48f786bf3 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:24.689864 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-6a14faa9-c4aa-462d-ac8b-b5852fea0dcb req-14e55e9b-05a9-40b7-9b00-08c48f786bf3 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:24.690322 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-6a14faa9-c4aa-462d-ac8b-b5852fea0dcb req-14e55e9b-05a9-40b7-9b00-08c48f786bf3 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:24.701742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-6a14faa9-c4aa-462d-ac8b-b5852fea0dcb req-14e55e9b-05a9-40b7-9b00-08c48f786bf3 service nova] Creating event network-vif-plugged:e09f28fa-7224-41d2-b9f8-5ce2b96f6acc for instance dcc3934b-d598-47c2-9fcb-404b2fe5a478 on hv-cinder-85236 Aug 26 11:05:24.711417 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-6a14faa9-c4aa-462d-ac8b-b5852fea0dcb req-14e55e9b-05a9-40b7-9b00-08c48f786bf3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035585 Aug 26 11:05:24.712038 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 62/114] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:05:24.824772 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5395d3f3-3cef-48d7-96d5-7818a6623d57 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:24.843134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5395d3f3-3cef-48d7-96d5-7818a6623d57 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1516 microversion: 2.1 time: 0.206498 Aug 26 11:05:24.845026 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 53/115] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:24 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1516 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:24.868208 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d3b3fc3a-d0de-4bd4-a9c3-cd527b774966 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:24.874500 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d3b3fc3a-d0de-4bd4-a9c3-cd527b774966 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:24.897168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3b3fc3a-d0de-4bd4-a9c3-cd527b774966 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:24.900003 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3b3fc3a-d0de-4bd4-a9c3-cd527b774966 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:24.900668 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3b3fc3a-d0de-4bd4-a9c3-cd527b774966 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:24.903992 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3b3fc3a-d0de-4bd4-a9c3-cd527b774966 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:24.905221 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3b3fc3a-d0de-4bd4-a9c3-cd527b774966 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:24.905935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3b3fc3a-d0de-4bd4-a9c3-cd527b774966 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:24.986290 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-d3b3fc3a-d0de-4bd4-a9c3-cd527b774966 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lazy-loading 'flavor' on Instance uuid b78ce714-fb3b-4478-9d40-7e298961441e {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:05:25.129901 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-54ed8072-cf2c-4618-aafb-f4013ee6d53b tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:25.130831 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-54ed8072-cf2c-4618-aafb-f4013ee6d53b tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:25.137777 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-54ed8072-cf2c-4618-aafb-f4013ee6d53b tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:25.138566 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-54ed8072-cf2c-4618-aafb-f4013ee6d53b tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:25.139230 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-54ed8072-cf2c-4618-aafb-f4013ee6d53b tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:25.140205 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-54ed8072-cf2c-4618-aafb-f4013ee6d53b tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:25.140939 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-54ed8072-cf2c-4618-aafb-f4013ee6d53b tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:25.141551 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-54ed8072-cf2c-4618-aafb-f4013ee6d53b tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:25.188591 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d3b3fc3a-d0de-4bd4-a9c3-cd527b774966 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "POST /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e/action" status: 200 len: 32 microversion: 2.1 time: 0.325148 Aug 26 11:05:25.190308 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 63/116] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 11:05:24 2022] POST /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e/action => generated 32 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 11:05:25.212508 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ccc26aaa-ac68-445d-9f15-33687a237192 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:25.213641 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ccc26aaa-ac68-445d-9f15-33687a237192 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:25.220412 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ccc26aaa-ac68-445d-9f15-33687a237192 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:25.221143 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ccc26aaa-ac68-445d-9f15-33687a237192 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:25.221779 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ccc26aaa-ac68-445d-9f15-33687a237192 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:25.222730 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ccc26aaa-ac68-445d-9f15-33687a237192 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:25.223472 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ccc26aaa-ac68-445d-9f15-33687a237192 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:25.224184 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ccc26aaa-ac68-445d-9f15-33687a237192 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:25.379492 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-54ed8072-cf2c-4618-aafb-f4013ee6d53b tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:25.393212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-54ed8072-cf2c-4618-aafb-f4013ee6d53b tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1315 microversion: 2.1 time: 0.266848 Aug 26 11:05:25.394426 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 54/117] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:25 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:25.441652 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ccc26aaa-ac68-445d-9f15-33687a237192 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:25.450036 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ccc26aaa-ac68-445d-9f15-33687a237192 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.242636 Aug 26 11:05:25.450779 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 64/118] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:25 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:25.658882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-00342358-78c9-4a4b-a72b-f63dbdfa6ac0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:25.659503 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-00342358-78c9-4a4b-a72b-f63dbdfa6ac0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:25.666468 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-00342358-78c9-4a4b-a72b-f63dbdfa6ac0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:25.666958 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-00342358-78c9-4a4b-a72b-f63dbdfa6ac0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:25.667726 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-00342358-78c9-4a4b-a72b-f63dbdfa6ac0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:25.668585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-00342358-78c9-4a4b-a72b-f63dbdfa6ac0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:25.669253 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-00342358-78c9-4a4b-a72b-f63dbdfa6ac0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:25.669854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-00342358-78c9-4a4b-a72b-f63dbdfa6ac0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:25.697495 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-31bbc794-d1f0-4391-a9cf-b9034ea9ce3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:25.698130 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-31bbc794-d1f0-4391-a9cf-b9034ea9ce3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:25.706779 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31bbc794-d1f0-4391-a9cf-b9034ea9ce3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:25.707272 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31bbc794-d1f0-4391-a9cf-b9034ea9ce3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:25.707708 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31bbc794-d1f0-4391-a9cf-b9034ea9ce3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:25.708406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31bbc794-d1f0-4391-a9cf-b9034ea9ce3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:25.708856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31bbc794-d1f0-4391-a9cf-b9034ea9ce3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:25.709321 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31bbc794-d1f0-4391-a9cf-b9034ea9ce3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:26.015657 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-31bbc794-d1f0-4391-a9cf-b9034ea9ce3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:26.025746 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-31bbc794-d1f0-4391-a9cf-b9034ea9ce3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.332856 Aug 26 11:05:26.026356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 65/119] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:25 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:05:26.043229 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-00342358-78c9-4a4b-a72b-f63dbdfa6ac0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:26.051985 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-00342358-78c9-4a4b-a72b-f63dbdfa6ac0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:26.054511 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-00342358-78c9-4a4b-a72b-f63dbdfa6ac0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:26.055685 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-00342358-78c9-4a4b-a72b-f63dbdfa6ac0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.400630 Aug 26 11:05:26.056246 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 55/120] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:25 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:26.415533 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a51da5d2-8963-4568-9fbb-4af68c5e711d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:26.416311 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a51da5d2-8963-4568-9fbb-4af68c5e711d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:26.422531 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a51da5d2-8963-4568-9fbb-4af68c5e711d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:26.422955 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a51da5d2-8963-4568-9fbb-4af68c5e711d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:26.423436 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a51da5d2-8963-4568-9fbb-4af68c5e711d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:26.424086 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a51da5d2-8963-4568-9fbb-4af68c5e711d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:26.424541 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a51da5d2-8963-4568-9fbb-4af68c5e711d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:26.424971 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a51da5d2-8963-4568-9fbb-4af68c5e711d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:26.470593 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-169805c7-f860-45a2-9ebf-08400a38e8a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:26.471233 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-169805c7-f860-45a2-9ebf-08400a38e8a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:26.477750 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-169805c7-f860-45a2-9ebf-08400a38e8a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:26.478252 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-169805c7-f860-45a2-9ebf-08400a38e8a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:26.478682 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-169805c7-f860-45a2-9ebf-08400a38e8a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:26.479367 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-169805c7-f860-45a2-9ebf-08400a38e8a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:26.479811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-169805c7-f860-45a2-9ebf-08400a38e8a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:26.480226 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-169805c7-f860-45a2-9ebf-08400a38e8a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:26.597103 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a51da5d2-8963-4568-9fbb-4af68c5e711d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:26.605617 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a51da5d2-8963-4568-9fbb-4af68c5e711d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1502 microversion: 2.1 time: 0.194650 Aug 26 11:05:26.606527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 66/121] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:26 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:26.643451 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-169805c7-f860-45a2-9ebf-08400a38e8a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:26.651232 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-169805c7-f860-45a2-9ebf-08400a38e8a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.184412 Aug 26 11:05:26.651799 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 56/122] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:26 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:05:26.728029 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-b6b19caf-fade-47a2-86db-4d96b9be85ef req-9e387a2b-647a-4b4e-8bd2-cc7e5e137c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ae91d9-0521-4d14-b2b6-e56f249c4181", "name": "network-vif-plugged", "status": "completed", "tag": "36a4faa3-3a22-4156-8542-c0c5ea7e7f1c"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:26.737340 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-b6b19caf-fade-47a2-86db-4d96b9be85ef req-9e387a2b-647a-4b4e-8bd2-cc7e5e137c8d service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:26.737818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-b6b19caf-fade-47a2-86db-4d96b9be85ef req-9e387a2b-647a-4b4e-8bd2-cc7e5e137c8d service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:26.738274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-b6b19caf-fade-47a2-86db-4d96b9be85ef req-9e387a2b-647a-4b4e-8bd2-cc7e5e137c8d service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:26.750105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-b6b19caf-fade-47a2-86db-4d96b9be85ef req-9e387a2b-647a-4b4e-8bd2-cc7e5e137c8d service nova] Creating event network-vif-plugged:36a4faa3-3a22-4156-8542-c0c5ea7e7f1c for instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 on hv-cinder-85236 Aug 26 11:05:26.755739 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-b6b19caf-fade-47a2-86db-4d96b9be85ef req-9e387a2b-647a-4b4e-8bd2-cc7e5e137c8d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031819 Aug 26 11:05:26.756984 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 67/123] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:05:27.048786 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-7d62826a-1eae-4163-8dc2-dc66897b8d87 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:27.049632 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-7d62826a-1eae-4163-8dc2-dc66897b8d87 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:27.056022 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d62826a-1eae-4163-8dc2-dc66897b8d87 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:27.056601 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d62826a-1eae-4163-8dc2-dc66897b8d87 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:27.057107 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d62826a-1eae-4163-8dc2-dc66897b8d87 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:27.057888 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d62826a-1eae-4163-8dc2-dc66897b8d87 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:27.058444 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d62826a-1eae-4163-8dc2-dc66897b8d87 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:27.058932 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d62826a-1eae-4163-8dc2-dc66897b8d87 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:27.079866 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-68498025-bdc1-432d-85b1-ae2e0e489429 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:27.080553 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-68498025-bdc1-432d-85b1-ae2e0e489429 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:27.087669 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68498025-bdc1-432d-85b1-ae2e0e489429 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:27.088144 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68498025-bdc1-432d-85b1-ae2e0e489429 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:27.088572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68498025-bdc1-432d-85b1-ae2e0e489429 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:27.096267 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68498025-bdc1-432d-85b1-ae2e0e489429 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:27.096767 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68498025-bdc1-432d-85b1-ae2e0e489429 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:27.097211 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68498025-bdc1-432d-85b1-ae2e0e489429 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:27.254495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7d62826a-1eae-4163-8dc2-dc66897b8d87 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:27.263352 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-7d62826a-1eae-4163-8dc2-dc66897b8d87 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.218773 Aug 26 11:05:27.264227 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 57/124] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:27 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:27.286603 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-68498025-bdc1-432d-85b1-ae2e0e489429 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:27.297454 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-68498025-bdc1-432d-85b1-ae2e0e489429 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:27.299117 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-68498025-bdc1-432d-85b1-ae2e0e489429 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:27.300461 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-68498025-bdc1-432d-85b1-ae2e0e489429 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.225208 Aug 26 11:05:27.302575 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 68/125] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:27 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:27.671768 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-19d4f6cb-096f-42fd-a4c9-dea49879a872 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:27.672262 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-19d4f6cb-096f-42fd-a4c9-dea49879a872 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:27.680504 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-19d4f6cb-096f-42fd-a4c9-dea49879a872 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:27.681935 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-19d4f6cb-096f-42fd-a4c9-dea49879a872 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:27.682697 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-19d4f6cb-096f-42fd-a4c9-dea49879a872 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:27.684088 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-19d4f6cb-096f-42fd-a4c9-dea49879a872 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:27.684883 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-19d4f6cb-096f-42fd-a4c9-dea49879a872 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:27.685835 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-19d4f6cb-096f-42fd-a4c9-dea49879a872 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:27.860826 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-19d4f6cb-096f-42fd-a4c9-dea49879a872 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:27.869716 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-19d4f6cb-096f-42fd-a4c9-dea49879a872 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.202042 Aug 26 11:05:27.878591 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 58/126] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:27 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:28.287408 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1cd03cda-94c9-4be5-a069-1f8fbd343ec6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:28.288368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1cd03cda-94c9-4be5-a069-1f8fbd343ec6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:28.295501 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1cd03cda-94c9-4be5-a069-1f8fbd343ec6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:28.295990 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1cd03cda-94c9-4be5-a069-1f8fbd343ec6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:28.296428 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1cd03cda-94c9-4be5-a069-1f8fbd343ec6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:28.297115 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1cd03cda-94c9-4be5-a069-1f8fbd343ec6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:28.297564 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1cd03cda-94c9-4be5-a069-1f8fbd343ec6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:28.297995 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1cd03cda-94c9-4be5-a069-1f8fbd343ec6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:28.325280 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-cd992d5c-8481-4a7a-a465-39a5562e501f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:28.325884 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-cd992d5c-8481-4a7a-a465-39a5562e501f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:28.331790 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd992d5c-8481-4a7a-a465-39a5562e501f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:28.332273 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd992d5c-8481-4a7a-a465-39a5562e501f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:28.332702 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd992d5c-8481-4a7a-a465-39a5562e501f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:28.333381 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd992d5c-8481-4a7a-a465-39a5562e501f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:28.333826 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd992d5c-8481-4a7a-a465-39a5562e501f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:28.334906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd992d5c-8481-4a7a-a465-39a5562e501f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:28.483028 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1cd03cda-94c9-4be5-a069-1f8fbd343ec6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:28.493104 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1cd03cda-94c9-4be5-a069-1f8fbd343ec6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.210034 Aug 26 11:05:28.502247 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 69/127] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:28 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:28.506590 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-cd992d5c-8481-4a7a-a465-39a5562e501f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:28.516809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-cd992d5c-8481-4a7a-a465-39a5562e501f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:28.518286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-cd992d5c-8481-4a7a-a465-39a5562e501f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:28.519387 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-cd992d5c-8481-4a7a-a465-39a5562e501f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.197956 Aug 26 11:05:28.519928 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 59/128] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:28 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:05:28.898478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-533579d1-dc70-4c9f-83b2-309d6bee2f2e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:28.899102 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-533579d1-dc70-4c9f-83b2-309d6bee2f2e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:28.904963 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-533579d1-dc70-4c9f-83b2-309d6bee2f2e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:28.905444 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-533579d1-dc70-4c9f-83b2-309d6bee2f2e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:28.905875 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-533579d1-dc70-4c9f-83b2-309d6bee2f2e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:28.906585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-533579d1-dc70-4c9f-83b2-309d6bee2f2e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:28.907035 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-533579d1-dc70-4c9f-83b2-309d6bee2f2e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:28.907456 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-533579d1-dc70-4c9f-83b2-309d6bee2f2e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:29.038494 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-533579d1-dc70-4c9f-83b2-309d6bee2f2e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:29.046182 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-533579d1-dc70-4c9f-83b2-309d6bee2f2e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.151478 Aug 26 11:05:29.046740 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 70/129] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:28 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:29.517953 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-d331382b-1436-4477-8eca-6c6eb32b7407 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:29.519262 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-d331382b-1436-4477-8eca-6c6eb32b7407 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:29.528563 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d331382b-1436-4477-8eca-6c6eb32b7407 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:29.529275 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d331382b-1436-4477-8eca-6c6eb32b7407 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:29.529916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d331382b-1436-4477-8eca-6c6eb32b7407 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:29.530852 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d331382b-1436-4477-8eca-6c6eb32b7407 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:29.531487 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d331382b-1436-4477-8eca-6c6eb32b7407 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:29.532082 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d331382b-1436-4477-8eca-6c6eb32b7407 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:29.541655 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3577d019-0915-466e-b594-c00e70fb224f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:29.542376 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3577d019-0915-466e-b594-c00e70fb224f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:29.549189 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3577d019-0915-466e-b594-c00e70fb224f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:29.553069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3577d019-0915-466e-b594-c00e70fb224f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:29.554853 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3577d019-0915-466e-b594-c00e70fb224f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:29.557119 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3577d019-0915-466e-b594-c00e70fb224f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:29.557962 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3577d019-0915-466e-b594-c00e70fb224f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:29.559066 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3577d019-0915-466e-b594-c00e70fb224f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:29.824319 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-d331382b-1436-4477-8eca-6c6eb32b7407 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:29.835570 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3577d019-0915-466e-b594-c00e70fb224f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:29.836947 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-d331382b-1436-4477-8eca-6c6eb32b7407 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.325462 Aug 26 11:05:29.837548 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 60/130] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:29 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:29.863903 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3577d019-0915-466e-b594-c00e70fb224f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:29.865484 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3577d019-0915-466e-b594-c00e70fb224f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:29.866680 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3577d019-0915-466e-b594-c00e70fb224f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.329050 Aug 26 11:05:29.867505 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 71/131] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:29 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:30.067291 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-35756e37-190c-46c1-93f1-4936e2f7ec83 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:30.067931 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-35756e37-190c-46c1-93f1-4936e2f7ec83 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:30.074821 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-35756e37-190c-46c1-93f1-4936e2f7ec83 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:30.075369 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-35756e37-190c-46c1-93f1-4936e2f7ec83 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:30.075860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-35756e37-190c-46c1-93f1-4936e2f7ec83 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:30.076611 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-35756e37-190c-46c1-93f1-4936e2f7ec83 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:30.077135 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-35756e37-190c-46c1-93f1-4936e2f7ec83 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:30.077630 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-35756e37-190c-46c1-93f1-4936e2f7ec83 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:30.203883 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-35756e37-190c-46c1-93f1-4936e2f7ec83 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:30.211440 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-35756e37-190c-46c1-93f1-4936e2f7ec83 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.148064 Aug 26 11:05:30.212005 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 61/132] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:30 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:30.857075 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6ee4e2e7-b30e-420d-b7d7-c2e12a6d4a36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:30.857584 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6ee4e2e7-b30e-420d-b7d7-c2e12a6d4a36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:30.863596 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6ee4e2e7-b30e-420d-b7d7-c2e12a6d4a36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:30.864080 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6ee4e2e7-b30e-420d-b7d7-c2e12a6d4a36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:30.864516 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6ee4e2e7-b30e-420d-b7d7-c2e12a6d4a36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:30.865216 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6ee4e2e7-b30e-420d-b7d7-c2e12a6d4a36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:30.865807 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6ee4e2e7-b30e-420d-b7d7-c2e12a6d4a36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:30.866370 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6ee4e2e7-b30e-420d-b7d7-c2e12a6d4a36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:30.891428 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-7474640e-a918-46c9-ad7c-6340288244c7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:30.891428 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-7474640e-a918-46c9-ad7c-6340288244c7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:30.897352 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7474640e-a918-46c9-ad7c-6340288244c7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:30.897854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7474640e-a918-46c9-ad7c-6340288244c7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:30.898379 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7474640e-a918-46c9-ad7c-6340288244c7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:30.899155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7474640e-a918-46c9-ad7c-6340288244c7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:30.899532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7474640e-a918-46c9-ad7c-6340288244c7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:30.899953 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7474640e-a918-46c9-ad7c-6340288244c7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:31.055941 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6ee4e2e7-b30e-420d-b7d7-c2e12a6d4a36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:31.065111 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6ee4e2e7-b30e-420d-b7d7-c2e12a6d4a36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.211916 Aug 26 11:05:31.065952 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 72/133] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:30 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:31.082903 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7474640e-a918-46c9-ad7c-6340288244c7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:31.092364 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7474640e-a918-46c9-ad7c-6340288244c7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:31.093880 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7474640e-a918-46c9-ad7c-6340288244c7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:31.095043 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-7474640e-a918-46c9-ad7c-6340288244c7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.208788 Aug 26 11:05:31.095600 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 62/134] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:30 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:31.231708 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-49bb067b-c81e-4abf-8541-2d602f7e6646 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:31.232314 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-49bb067b-c81e-4abf-8541-2d602f7e6646 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:31.238155 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49bb067b-c81e-4abf-8541-2d602f7e6646 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:31.238628 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49bb067b-c81e-4abf-8541-2d602f7e6646 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:31.239050 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49bb067b-c81e-4abf-8541-2d602f7e6646 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:31.239723 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49bb067b-c81e-4abf-8541-2d602f7e6646 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:31.240166 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49bb067b-c81e-4abf-8541-2d602f7e6646 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:31.240585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49bb067b-c81e-4abf-8541-2d602f7e6646 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:31.372960 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-49bb067b-c81e-4abf-8541-2d602f7e6646 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:31.375320 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:31.382854 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-49bb067b-c81e-4abf-8541-2d602f7e6646 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.154868 Aug 26 11:05:31.383421 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 73/135] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:31 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:32.086409 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-d67c09d0-af4f-4140-b410-d4ac775c8db8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:32.087024 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-d67c09d0-af4f-4140-b410-d4ac775c8db8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:32.092888 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d67c09d0-af4f-4140-b410-d4ac775c8db8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:32.093370 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d67c09d0-af4f-4140-b410-d4ac775c8db8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:32.093805 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d67c09d0-af4f-4140-b410-d4ac775c8db8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:32.094530 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d67c09d0-af4f-4140-b410-d4ac775c8db8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:32.095035 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d67c09d0-af4f-4140-b410-d4ac775c8db8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:32.095462 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d67c09d0-af4f-4140-b410-d4ac775c8db8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:32.118263 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d04a12df-39de-4c5a-8def-db9bd8bc06be tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:32.118875 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d04a12df-39de-4c5a-8def-db9bd8bc06be tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:32.125383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d04a12df-39de-4c5a-8def-db9bd8bc06be tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:32.125867 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d04a12df-39de-4c5a-8def-db9bd8bc06be tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:32.126326 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d04a12df-39de-4c5a-8def-db9bd8bc06be tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:32.127015 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d04a12df-39de-4c5a-8def-db9bd8bc06be tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:32.127463 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d04a12df-39de-4c5a-8def-db9bd8bc06be tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:32.127882 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d04a12df-39de-4c5a-8def-db9bd8bc06be tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:32.300915 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-d67c09d0-af4f-4140-b410-d4ac775c8db8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:32.308845 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d04a12df-39de-4c5a-8def-db9bd8bc06be tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:32.309013 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-d67c09d0-af4f-4140-b410-d4ac775c8db8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.226736 Aug 26 11:05:32.309567 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 63/136] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:32 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:32.316919 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d04a12df-39de-4c5a-8def-db9bd8bc06be tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:32.319065 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d04a12df-39de-4c5a-8def-db9bd8bc06be tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:32.320364 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d04a12df-39de-4c5a-8def-db9bd8bc06be tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.207571 Aug 26 11:05:32.320911 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 74/137] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:32 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:05:32.402983 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4752ac21-ff9e-4f36-9669-a9d87be5a0a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:32.403594 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4752ac21-ff9e-4f36-9669-a9d87be5a0a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:32.409328 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4752ac21-ff9e-4f36-9669-a9d87be5a0a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:32.409814 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4752ac21-ff9e-4f36-9669-a9d87be5a0a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:32.410305 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4752ac21-ff9e-4f36-9669-a9d87be5a0a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:32.410996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4752ac21-ff9e-4f36-9669-a9d87be5a0a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:32.411450 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4752ac21-ff9e-4f36-9669-a9d87be5a0a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:32.411871 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4752ac21-ff9e-4f36-9669-a9d87be5a0a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:32.539096 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4752ac21-ff9e-4f36-9669-a9d87be5a0a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:32.546717 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4752ac21-ff9e-4f36-9669-a9d87be5a0a9 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.147451 Aug 26 11:05:32.547284 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 64/138] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:32 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:33.330723 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ba344fe7-5765-4464-870e-7758bc685576 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:33.331245 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ba344fe7-5765-4464-870e-7758bc685576 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:33.337469 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba344fe7-5765-4464-870e-7758bc685576 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:33.337811 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba344fe7-5765-4464-870e-7758bc685576 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:33.338276 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba344fe7-5765-4464-870e-7758bc685576 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:33.338974 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba344fe7-5765-4464-870e-7758bc685576 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:33.339626 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba344fe7-5765-4464-870e-7758bc685576 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:33.340048 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba344fe7-5765-4464-870e-7758bc685576 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:33.346022 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-7a759450-5174-44c3-9edb-6d88025156a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:33.348049 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-7a759450-5174-44c3-9edb-6d88025156a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:33.366143 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7a759450-5174-44c3-9edb-6d88025156a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:33.366691 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7a759450-5174-44c3-9edb-6d88025156a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:33.368114 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7a759450-5174-44c3-9edb-6d88025156a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:33.368983 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7a759450-5174-44c3-9edb-6d88025156a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:33.369439 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7a759450-5174-44c3-9edb-6d88025156a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:33.369862 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7a759450-5174-44c3-9edb-6d88025156a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:33.560751 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ba344fe7-5765-4464-870e-7758bc685576 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:33.567531 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7a759450-5174-44c3-9edb-6d88025156a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:33.568488 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ba344fe7-5765-4464-870e-7758bc685576 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.241766 Aug 26 11:05:33.569062 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 75/139] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:33 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:33.573510 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ab7aa85d-738a-417b-823d-196dd49e8d04 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:33.574130 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ab7aa85d-738a-417b-823d-196dd49e8d04 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:33.575909 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7a759450-5174-44c3-9edb-6d88025156a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:33.577392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7a759450-5174-44c3-9edb-6d88025156a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:33.578537 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-7a759450-5174-44c3-9edb-6d88025156a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.239183 Aug 26 11:05:33.586144 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 65/140] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:33 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:33.586281 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ab7aa85d-738a-417b-823d-196dd49e8d04 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:33.586281 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ab7aa85d-738a-417b-823d-196dd49e8d04 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:33.586281 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ab7aa85d-738a-417b-823d-196dd49e8d04 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:33.586281 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ab7aa85d-738a-417b-823d-196dd49e8d04 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:33.586580 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ab7aa85d-738a-417b-823d-196dd49e8d04 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:33.586580 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ab7aa85d-738a-417b-823d-196dd49e8d04 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:33.712606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ab7aa85d-738a-417b-823d-196dd49e8d04 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:33.720150 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ab7aa85d-738a-417b-823d-196dd49e8d04 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.150172 Aug 26 11:05:33.720713 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 76/141] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:33 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:34.296390 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f924e769-fcb4-4f73-9dcd-64a1d6454424 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7505e224-e80b-4826-a684-3ca7c3d2162e"}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:34.298868 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f924e769-fcb4-4f73-9dcd-64a1d6454424 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:34.305558 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f924e769-fcb4-4f73-9dcd-64a1d6454424 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:34.306072 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f924e769-fcb4-4f73-9dcd-64a1d6454424 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:34.306503 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f924e769-fcb4-4f73-9dcd-64a1d6454424 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:34.307183 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f924e769-fcb4-4f73-9dcd-64a1d6454424 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:34.307632 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f924e769-fcb4-4f73-9dcd-64a1d6454424 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:34.308051 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f924e769-fcb4-4f73-9dcd-64a1d6454424 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:34.588969 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-07f8e958-6121-4800-a954-0703a8c7896d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:34.589586 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-07f8e958-6121-4800-a954-0703a8c7896d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:34.595475 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-07f8e958-6121-4800-a954-0703a8c7896d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:34.595954 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-07f8e958-6121-4800-a954-0703a8c7896d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:34.596392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-07f8e958-6121-4800-a954-0703a8c7896d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:34.597078 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-07f8e958-6121-4800-a954-0703a8c7896d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:34.597531 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-07f8e958-6121-4800-a954-0703a8c7896d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:34.597951 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-07f8e958-6121-4800-a954-0703a8c7896d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:34.721543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-07f8e958-6121-4800-a954-0703a8c7896d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:34.729829 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-07f8e958-6121-4800-a954-0703a8c7896d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.144646 Aug 26 11:05:34.730424 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 77/142] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:34 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:05:34.734793 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-360dda14-5e30-4003-96a2-a471557ab528 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:34.735395 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-360dda14-5e30-4003-96a2-a471557ab528 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:34.741045 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-360dda14-5e30-4003-96a2-a471557ab528 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:34.741525 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-360dda14-5e30-4003-96a2-a471557ab528 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:34.742250 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-360dda14-5e30-4003-96a2-a471557ab528 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:34.742942 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-360dda14-5e30-4003-96a2-a471557ab528 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:34.743393 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-360dda14-5e30-4003-96a2-a471557ab528 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:34.743818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-360dda14-5e30-4003-96a2-a471557ab528 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:34.875246 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-360dda14-5e30-4003-96a2-a471557ab528 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:34.883842 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-360dda14-5e30-4003-96a2-a471557ab528 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:34.885281 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-360dda14-5e30-4003-96a2-a471557ab528 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:34.886388 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-360dda14-5e30-4003-96a2-a471557ab528 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.155039 Aug 26 11:05:34.886933 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 78/143] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:34 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:34.891163 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-48df802a-eb77-4df0-84a4-1e008cb86785 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:34.891759 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-48df802a-eb77-4df0-84a4-1e008cb86785 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:34.897771 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-48df802a-eb77-4df0-84a4-1e008cb86785 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:34.898279 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-48df802a-eb77-4df0-84a4-1e008cb86785 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:34.898705 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-48df802a-eb77-4df0-84a4-1e008cb86785 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:34.899381 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-48df802a-eb77-4df0-84a4-1e008cb86785 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:34.899827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-48df802a-eb77-4df0-84a4-1e008cb86785 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:34.900239 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-48df802a-eb77-4df0-84a4-1e008cb86785 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:35.025776 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-48df802a-eb77-4df0-84a4-1e008cb86785 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:35.033370 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-48df802a-eb77-4df0-84a4-1e008cb86785 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.145517 Aug 26 11:05:35.033931 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 79/144] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:34 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:35.751157 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e5d962b8-93ad-4e3a-bb60-b52d23cb6b48 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:35.751773 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e5d962b8-93ad-4e3a-bb60-b52d23cb6b48 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:35.757699 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5d962b8-93ad-4e3a-bb60-b52d23cb6b48 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:35.758216 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5d962b8-93ad-4e3a-bb60-b52d23cb6b48 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:35.758648 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5d962b8-93ad-4e3a-bb60-b52d23cb6b48 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:35.759330 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5d962b8-93ad-4e3a-bb60-b52d23cb6b48 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:35.759778 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5d962b8-93ad-4e3a-bb60-b52d23cb6b48 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:35.760200 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5d962b8-93ad-4e3a-bb60-b52d23cb6b48 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:35.889133 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e5d962b8-93ad-4e3a-bb60-b52d23cb6b48 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:35.897269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e5d962b8-93ad-4e3a-bb60-b52d23cb6b48 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.149397 Aug 26 11:05:35.897829 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 80/145] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:35 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:05:35.908230 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0d344737-1889-4812-9043-288aca9b512d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:35.908853 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0d344737-1889-4812-9043-288aca9b512d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:35.915087 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d344737-1889-4812-9043-288aca9b512d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:35.915562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d344737-1889-4812-9043-288aca9b512d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:35.915987 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d344737-1889-4812-9043-288aca9b512d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:35.916664 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d344737-1889-4812-9043-288aca9b512d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:35.917106 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d344737-1889-4812-9043-288aca9b512d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:35.917519 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d344737-1889-4812-9043-288aca9b512d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:36.047057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0d344737-1889-4812-9043-288aca9b512d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:36.055214 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0d344737-1889-4812-9043-288aca9b512d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:36.056677 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0d344737-1889-4812-9043-288aca9b512d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:36.057760 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0d344737-1889-4812-9043-288aca9b512d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.153178 Aug 26 11:05:36.058333 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 81/146] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:35 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:05:36.062610 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0fc8b9a3-e4a4-4555-b1cc-12b9bd851a9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:36.063202 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0fc8b9a3-e4a4-4555-b1cc-12b9bd851a9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:36.068637 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0fc8b9a3-e4a4-4555-b1cc-12b9bd851a9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:36.069109 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0fc8b9a3-e4a4-4555-b1cc-12b9bd851a9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:36.069531 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0fc8b9a3-e4a4-4555-b1cc-12b9bd851a9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:36.070228 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0fc8b9a3-e4a4-4555-b1cc-12b9bd851a9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:36.070674 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0fc8b9a3-e4a4-4555-b1cc-12b9bd851a9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:36.071094 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0fc8b9a3-e4a4-4555-b1cc-12b9bd851a9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:36.197139 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0fc8b9a3-e4a4-4555-b1cc-12b9bd851a9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:36.204734 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0fc8b9a3-e4a4-4555-b1cc-12b9bd851a9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.145484 Aug 26 11:05:36.205293 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 82/147] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:36 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:36.649113 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f924e769-fcb4-4f73-9dcd-64a1d6454424 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "POST /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.356504 Aug 26 11:05:36.650367 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 66/148] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 11:05:34 2022] POST /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37/os-volume_attachments => generated 194 bytes in 2359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:05:36.672451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-0b70b615-8409-429a-8b38-ca1723a57e07 req-f32d6b65-2219-4c7b-8b55-529c7926ff16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcad555f-f60b-409e-9075-f4fcdbbba3fe", "name": "network-vif-plugged", "status": "completed", "tag": "65e305ab-f815-483f-8ea8-1d853476bc95"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:36.682931 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-0b70b615-8409-429a-8b38-ca1723a57e07 req-f32d6b65-2219-4c7b-8b55-529c7926ff16 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:36.683407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-0b70b615-8409-429a-8b38-ca1723a57e07 req-f32d6b65-2219-4c7b-8b55-529c7926ff16 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:36.683847 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-0b70b615-8409-429a-8b38-ca1723a57e07 req-f32d6b65-2219-4c7b-8b55-529c7926ff16 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:36.698039 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-0b70b615-8409-429a-8b38-ca1723a57e07 req-f32d6b65-2219-4c7b-8b55-529c7926ff16 service nova] Creating event network-vif-plugged:65e305ab-f815-483f-8ea8-1d853476bc95 for instance fcad555f-f60b-409e-9075-f4fcdbbba3fe on hv-cinder-85236 Aug 26 11:05:36.703035 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-0b70b615-8409-429a-8b38-ca1723a57e07 req-f32d6b65-2219-4c7b-8b55-529c7926ff16 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034303 Aug 26 11:05:36.703770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 83/149] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:05:36.918360 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-97980043-3ab6-4e75-a78b-5f75f7da3a49 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:36.919144 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-97980043-3ab6-4e75-a78b-5f75f7da3a49 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:36.927308 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-97980043-3ab6-4e75-a78b-5f75f7da3a49 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:36.928364 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-97980043-3ab6-4e75-a78b-5f75f7da3a49 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:36.929025 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-97980043-3ab6-4e75-a78b-5f75f7da3a49 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:36.929714 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-97980043-3ab6-4e75-a78b-5f75f7da3a49 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:36.930200 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-97980043-3ab6-4e75-a78b-5f75f7da3a49 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:36.930621 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-97980043-3ab6-4e75-a78b-5f75f7da3a49 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:37.070025 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-97980043-3ab6-4e75-a78b-5f75f7da3a49 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:37.077594 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-97980043-3ab6-4e75-a78b-5f75f7da3a49 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.163512 Aug 26 11:05:37.078168 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 67/150] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:36 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:37.081866 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-136a66f4-6c87-4242-81c8-797c99f4192b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:37.082662 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-136a66f4-6c87-4242-81c8-797c99f4192b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:37.090991 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-136a66f4-6c87-4242-81c8-797c99f4192b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:37.091517 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-136a66f4-6c87-4242-81c8-797c99f4192b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:37.091954 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-136a66f4-6c87-4242-81c8-797c99f4192b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:37.092653 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-136a66f4-6c87-4242-81c8-797c99f4192b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:37.093100 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-136a66f4-6c87-4242-81c8-797c99f4192b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:37.093519 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-136a66f4-6c87-4242-81c8-797c99f4192b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:37.222547 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-136a66f4-6c87-4242-81c8-797c99f4192b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:37.227054 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-31e24659-4138-43b7-9de9-b43afde61e0e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:37.227671 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-31e24659-4138-43b7-9de9-b43afde61e0e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:37.231317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-136a66f4-6c87-4242-81c8-797c99f4192b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:37.232759 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-136a66f4-6c87-4242-81c8-797c99f4192b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:37.233854 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-136a66f4-6c87-4242-81c8-797c99f4192b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.157042 Aug 26 11:05:37.233970 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-31e24659-4138-43b7-9de9-b43afde61e0e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:37.234438 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 84/151] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:37 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:05:37.234565 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-31e24659-4138-43b7-9de9-b43afde61e0e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:37.234892 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-31e24659-4138-43b7-9de9-b43afde61e0e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:37.235587 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-31e24659-4138-43b7-9de9-b43afde61e0e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:37.236038 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-31e24659-4138-43b7-9de9-b43afde61e0e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:37.236463 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-31e24659-4138-43b7-9de9-b43afde61e0e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:37.239193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:37.370367 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-31e24659-4138-43b7-9de9-b43afde61e0e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:37.377862 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-31e24659-4138-43b7-9de9-b43afde61e0e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.155173 Aug 26 11:05:37.378454 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 68/152] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:37 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:05:38.101313 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5f0f1514-563f-4c43-b457-279fb3c1e078 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:38.101916 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5f0f1514-563f-4c43-b457-279fb3c1e078 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:38.107756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f0f1514-563f-4c43-b457-279fb3c1e078 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:38.108229 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f0f1514-563f-4c43-b457-279fb3c1e078 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:38.108663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f0f1514-563f-4c43-b457-279fb3c1e078 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:38.109336 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f0f1514-563f-4c43-b457-279fb3c1e078 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:38.109782 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f0f1514-563f-4c43-b457-279fb3c1e078 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:38.110226 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f0f1514-563f-4c43-b457-279fb3c1e078 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:38.257850 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-563bbd96-a11d-4fc9-8d57-bd214def0f21 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:38.258493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-563bbd96-a11d-4fc9-8d57-bd214def0f21 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:38.265477 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-563bbd96-a11d-4fc9-8d57-bd214def0f21 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:38.266004 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-563bbd96-a11d-4fc9-8d57-bd214def0f21 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:38.266449 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-563bbd96-a11d-4fc9-8d57-bd214def0f21 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:38.267162 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-563bbd96-a11d-4fc9-8d57-bd214def0f21 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:38.267616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-563bbd96-a11d-4fc9-8d57-bd214def0f21 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:38.268043 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-563bbd96-a11d-4fc9-8d57-bd214def0f21 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:38.476147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5f0f1514-563f-4c43-b457-279fb3c1e078 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:38.480683 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-563bbd96-a11d-4fc9-8d57-bd214def0f21 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:38.483776 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5f0f1514-563f-4c43-b457-279fb3c1e078 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.386759 Aug 26 11:05:38.484348 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 85/153] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:38 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:38.488673 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-563bbd96-a11d-4fc9-8d57-bd214def0f21 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:38.488833 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-61844d58-5a8e-4957-8726-1e2e3e36c00a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:38.489353 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-61844d58-5a8e-4957-8726-1e2e3e36c00a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:38.490125 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-563bbd96-a11d-4fc9-8d57-bd214def0f21 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:38.491430 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-563bbd96-a11d-4fc9-8d57-bd214def0f21 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.237627 Aug 26 11:05:38.494156 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 69/154] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:38 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:05:38.495519 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-61844d58-5a8e-4957-8726-1e2e3e36c00a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:38.496161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-61844d58-5a8e-4957-8726-1e2e3e36c00a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:38.496747 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-61844d58-5a8e-4957-8726-1e2e3e36c00a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:38.497659 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-61844d58-5a8e-4957-8726-1e2e3e36c00a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:38.498147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-61844d58-5a8e-4957-8726-1e2e3e36c00a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:38.498548 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-61844d58-5a8e-4957-8726-1e2e3e36c00a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:38.627978 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-61844d58-5a8e-4957-8726-1e2e3e36c00a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:38.636154 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-61844d58-5a8e-4957-8726-1e2e3e36c00a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.150872 Aug 26 11:05:38.636717 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 86/155] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:38 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:39.504589 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-13611a8a-6441-404f-957c-b62a69c381ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:39.505203 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-13611a8a-6441-404f-957c-b62a69c381ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:39.512070 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13611a8a-6441-404f-957c-b62a69c381ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:39.512556 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13611a8a-6441-404f-957c-b62a69c381ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:39.512994 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13611a8a-6441-404f-957c-b62a69c381ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:39.513688 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13611a8a-6441-404f-957c-b62a69c381ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:39.514173 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13611a8a-6441-404f-957c-b62a69c381ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:39.514588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7f281d6c-9bd9-4708-95e1-9cf767f361af tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:39.515036 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13611a8a-6441-404f-957c-b62a69c381ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:39.515198 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7f281d6c-9bd9-4708-95e1-9cf767f361af tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:39.521049 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f281d6c-9bd9-4708-95e1-9cf767f361af tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:39.521667 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f281d6c-9bd9-4708-95e1-9cf767f361af tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:39.522328 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f281d6c-9bd9-4708-95e1-9cf767f361af tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:39.523028 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f281d6c-9bd9-4708-95e1-9cf767f361af tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:39.523480 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f281d6c-9bd9-4708-95e1-9cf767f361af tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:39.523900 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f281d6c-9bd9-4708-95e1-9cf767f361af tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:39.697644 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-13611a8a-6441-404f-957c-b62a69c381ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:39.705242 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-13611a8a-6441-404f-957c-b62a69c381ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.204474 Aug 26 11:05:39.705819 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 70/156] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:39 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:39.709819 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7f281d6c-9bd9-4708-95e1-9cf767f361af tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:39.710943 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-ff9733cd-5453-4b1c-8e87-d3b452e96577 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:39.711547 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-ff9733cd-5453-4b1c-8e87-d3b452e96577 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:39.717181 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ff9733cd-5453-4b1c-8e87-d3b452e96577 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:39.717659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ff9733cd-5453-4b1c-8e87-d3b452e96577 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:39.718120 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ff9733cd-5453-4b1c-8e87-d3b452e96577 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:39.718243 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7f281d6c-9bd9-4708-95e1-9cf767f361af tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:39.718810 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ff9733cd-5453-4b1c-8e87-d3b452e96577 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:39.719257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ff9733cd-5453-4b1c-8e87-d3b452e96577 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:39.719614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7f281d6c-9bd9-4708-95e1-9cf767f361af tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:39.719762 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ff9733cd-5453-4b1c-8e87-d3b452e96577 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:39.721000 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7f281d6c-9bd9-4708-95e1-9cf767f361af tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1407 microversion: 2.20 time: 0.210265 Aug 26 11:05:39.721574 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 87/157] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:39 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:05:39.851879 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-ff9733cd-5453-4b1c-8e87-d3b452e96577 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:39.859625 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-ff9733cd-5453-4b1c-8e87-d3b452e96577 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.152790 Aug 26 11:05:39.860203 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 71/158] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:39 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:40.726956 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-05fe7e2d-e928-46da-8d43-0c943e0fba08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:40.727480 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-05fe7e2d-e928-46da-8d43-0c943e0fba08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:40.729768 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=96 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:40.734675 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-05fe7e2d-e928-46da-8d43-0c943e0fba08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:40.735156 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-05fe7e2d-e928-46da-8d43-0c943e0fba08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:40.735771 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-05fe7e2d-e928-46da-8d43-0c943e0fba08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:40.736639 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-05fe7e2d-e928-46da-8d43-0c943e0fba08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:40.737138 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-05fe7e2d-e928-46da-8d43-0c943e0fba08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:40.737556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-05fe7e2d-e928-46da-8d43-0c943e0fba08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:40.746110 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-cbae544d-e65a-4379-a06c-87f70bd96b2b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:40.746804 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-cbae544d-e65a-4379-a06c-87f70bd96b2b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:40.754368 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cbae544d-e65a-4379-a06c-87f70bd96b2b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:40.755258 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cbae544d-e65a-4379-a06c-87f70bd96b2b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:40.756602 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cbae544d-e65a-4379-a06c-87f70bd96b2b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:40.757545 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cbae544d-e65a-4379-a06c-87f70bd96b2b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:40.758102 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cbae544d-e65a-4379-a06c-87f70bd96b2b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:40.758626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cbae544d-e65a-4379-a06c-87f70bd96b2b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:40.973004 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-cbae544d-e65a-4379-a06c-87f70bd96b2b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:40.974261 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-05fe7e2d-e928-46da-8d43-0c943e0fba08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:40.982264 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-cbae544d-e65a-4379-a06c-87f70bd96b2b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:40.983053 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-05fe7e2d-e928-46da-8d43-0c943e0fba08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.260143 Aug 26 11:05:40.983705 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 88/159] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:40 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:40.983833 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-cbae544d-e65a-4379-a06c-87f70bd96b2b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:40.984866 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-cbae544d-e65a-4379-a06c-87f70bd96b2b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1600 microversion: 2.20 time: 0.244446 Aug 26 11:05:40.997999 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 72/160] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:05:40 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1600 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:05:41.001873 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-71e5bf5f-a9b1-4f87-8109-6a4391affd8b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:41.008528 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-71e5bf5f-a9b1-4f87-8109-6a4391affd8b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:41.014829 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71e5bf5f-a9b1-4f87-8109-6a4391affd8b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:41.014976 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-da81396d-d688-4ccb-93f7-b46f5dd97e27 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:41.015316 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71e5bf5f-a9b1-4f87-8109-6a4391affd8b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:41.015450 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-da81396d-d688-4ccb-93f7-b46f5dd97e27 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:41.015756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71e5bf5f-a9b1-4f87-8109-6a4391affd8b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:41.025388 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71e5bf5f-a9b1-4f87-8109-6a4391affd8b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:41.025388 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71e5bf5f-a9b1-4f87-8109-6a4391affd8b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:41.025388 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71e5bf5f-a9b1-4f87-8109-6a4391affd8b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:41.025607 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-da81396d-d688-4ccb-93f7-b46f5dd97e27 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:41.025607 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-da81396d-d688-4ccb-93f7-b46f5dd97e27 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:41.025607 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-da81396d-d688-4ccb-93f7-b46f5dd97e27 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:41.025607 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-da81396d-d688-4ccb-93f7-b46f5dd97e27 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:41.025872 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-da81396d-d688-4ccb-93f7-b46f5dd97e27 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:41.025872 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-da81396d-d688-4ccb-93f7-b46f5dd97e27 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:41.162989 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-da81396d-d688-4ccb-93f7-b46f5dd97e27 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.153587 Aug 26 11:05:41.163876 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 73/161] 10.222.0.40 () {60 vars in 1316 bytes} [Fri Aug 26 11:05:41 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/os-interface => generated 285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 11:05:41.335300 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-71e5bf5f-a9b1-4f87-8109-6a4391affd8b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:41.345254 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-71e5bf5f-a9b1-4f87-8109-6a4391affd8b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.360190 Aug 26 11:05:41.350009 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 89/162] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:40 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:42.010936 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c1a1e75f-9a20-40ac-bf37-ff637aaf153f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:42.012145 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c1a1e75f-9a20-40ac-bf37-ff637aaf153f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:42.025121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c1a1e75f-9a20-40ac-bf37-ff637aaf153f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:42.027037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c1a1e75f-9a20-40ac-bf37-ff637aaf153f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:42.027640 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c1a1e75f-9a20-40ac-bf37-ff637aaf153f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:42.030999 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c1a1e75f-9a20-40ac-bf37-ff637aaf153f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:42.032057 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c1a1e75f-9a20-40ac-bf37-ff637aaf153f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:42.033349 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c1a1e75f-9a20-40ac-bf37-ff637aaf153f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:42.367182 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ff20c07b-5cbe-403d-8218-d702ca5c4fb5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:42.367797 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ff20c07b-5cbe-403d-8218-d702ca5c4fb5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:42.378527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ff20c07b-5cbe-403d-8218-d702ca5c4fb5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:42.379022 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ff20c07b-5cbe-403d-8218-d702ca5c4fb5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:42.379563 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ff20c07b-5cbe-403d-8218-d702ca5c4fb5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:42.380666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ff20c07b-5cbe-403d-8218-d702ca5c4fb5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:42.380762 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c1a1e75f-9a20-40ac-bf37-ff637aaf153f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:42.380867 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ff20c07b-5cbe-403d-8218-d702ca5c4fb5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:42.381170 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ff20c07b-5cbe-403d-8218-d702ca5c4fb5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:42.392963 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c1a1e75f-9a20-40ac-bf37-ff637aaf153f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.390701 Aug 26 11:05:42.395490 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 74/163] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:42 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:42.655194 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ff20c07b-5cbe-403d-8218-d702ca5c4fb5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:42.665673 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ff20c07b-5cbe-403d-8218-d702ca5c4fb5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.302968 Aug 26 11:05:42.667340 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 90/164] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:42 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:05:43.088136 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-83e00141-1aba-46ab-889b-d47f16278bab req-f49c5036-d46b-44c9-a10b-b3ee685304e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01ae91d9-0521-4d14-b2b6-e56f249c4181", "tag": "36a4faa3-3a22-4156-8542-c0c5ea7e7f1c"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:43.111350 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-83e00141-1aba-46ab-889b-d47f16278bab req-f49c5036-d46b-44c9-a10b-b3ee685304e7 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:43.112837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-83e00141-1aba-46ab-889b-d47f16278bab req-f49c5036-d46b-44c9-a10b-b3ee685304e7 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:43.114483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-83e00141-1aba-46ab-889b-d47f16278bab req-f49c5036-d46b-44c9-a10b-b3ee685304e7 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:43.144682 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-83e00141-1aba-46ab-889b-d47f16278bab req-f49c5036-d46b-44c9-a10b-b3ee685304e7 service nova] Creating event network-changed:36a4faa3-3a22-4156-8542-c0c5ea7e7f1c for instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 on hv-cinder-85236 Aug 26 11:05:43.159104 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-83e00141-1aba-46ab-889b-d47f16278bab req-f49c5036-d46b-44c9-a10b-b3ee685304e7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074540 Aug 26 11:05:43.165053 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 75/165] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:05:43.417569 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-59ab754e-7cff-4e6d-95bb-bfcef7a3410f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:43.419142 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-59ab754e-7cff-4e6d-95bb-bfcef7a3410f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:43.430150 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-59ab754e-7cff-4e6d-95bb-bfcef7a3410f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:43.443678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-59ab754e-7cff-4e6d-95bb-bfcef7a3410f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:43.445001 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-59ab754e-7cff-4e6d-95bb-bfcef7a3410f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:43.448671 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-59ab754e-7cff-4e6d-95bb-bfcef7a3410f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:43.450976 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-59ab754e-7cff-4e6d-95bb-bfcef7a3410f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:43.452028 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-59ab754e-7cff-4e6d-95bb-bfcef7a3410f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:43.466812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=100 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:43.687855 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-280d6adb-d26f-4f73-a556-3798bb447612 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:43.689268 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-280d6adb-d26f-4f73-a556-3798bb447612 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:43.702619 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-59ab754e-7cff-4e6d-95bb-bfcef7a3410f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:43.703204 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-280d6adb-d26f-4f73-a556-3798bb447612 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:43.703710 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-280d6adb-d26f-4f73-a556-3798bb447612 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:43.704152 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-280d6adb-d26f-4f73-a556-3798bb447612 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:43.705860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-280d6adb-d26f-4f73-a556-3798bb447612 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:43.706353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-280d6adb-d26f-4f73-a556-3798bb447612 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:43.706786 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-280d6adb-d26f-4f73-a556-3798bb447612 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:43.714925 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-59ab754e-7cff-4e6d-95bb-bfcef7a3410f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1363 microversion: 2.1 time: 0.303212 Aug 26 11:05:43.716658 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 91/166] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:43 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:43.940234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-280d6adb-d26f-4f73-a556-3798bb447612 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:43.964389 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-280d6adb-d26f-4f73-a556-3798bb447612 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.280970 Aug 26 11:05:43.967812 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 76/167] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:43 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:44.737403 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-54ecbf8b-c748-429c-afd8-c63c35b049c1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:44.738786 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-54ecbf8b-c748-429c-afd8-c63c35b049c1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:44.750530 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-54ecbf8b-c748-429c-afd8-c63c35b049c1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:44.751259 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-54ecbf8b-c748-429c-afd8-c63c35b049c1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:44.752126 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-54ecbf8b-c748-429c-afd8-c63c35b049c1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:44.753186 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-54ecbf8b-c748-429c-afd8-c63c35b049c1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:44.754150 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-54ecbf8b-c748-429c-afd8-c63c35b049c1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:44.754934 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-54ecbf8b-c748-429c-afd8-c63c35b049c1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:44.956436 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-54ecbf8b-c748-429c-afd8-c63c35b049c1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:44.975458 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-54ecbf8b-c748-429c-afd8-c63c35b049c1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1548 microversion: 2.1 time: 0.242217 Aug 26 11:05:44.976389 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 92/168] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:44 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1548 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:44.992887 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-47b7c981-510b-4529-b757-75d62f30b463 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:44.994305 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-47b7c981-510b-4529-b757-75d62f30b463 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:44.998490 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=84 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:45.004765 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-47b7c981-510b-4529-b757-75d62f30b463 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:45.006527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-47b7c981-510b-4529-b757-75d62f30b463 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:45.007193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-47b7c981-510b-4529-b757-75d62f30b463 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:45.011976 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-47b7c981-510b-4529-b757-75d62f30b463 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:45.013413 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-47b7c981-510b-4529-b757-75d62f30b463 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:45.014594 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-47b7c981-510b-4529-b757-75d62f30b463 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:45.024851 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-01345f5e-4f70-4bfd-9f07-2cfc52fc01c5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:45.026493 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-01345f5e-4f70-4bfd-9f07-2cfc52fc01c5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:45.044284 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-01345f5e-4f70-4bfd-9f07-2cfc52fc01c5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:45.045034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-01345f5e-4f70-4bfd-9f07-2cfc52fc01c5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:45.045642 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-01345f5e-4f70-4bfd-9f07-2cfc52fc01c5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:45.046578 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-01345f5e-4f70-4bfd-9f07-2cfc52fc01c5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:45.047973 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-01345f5e-4f70-4bfd-9f07-2cfc52fc01c5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:45.051035 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-01345f5e-4f70-4bfd-9f07-2cfc52fc01c5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:45.185856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-01345f5e-4f70-4bfd-9f07-2cfc52fc01c5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185525 Aug 26 11:05:45.186630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 93/169] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 26 11:05:44 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:05:45.330833 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-47b7c981-510b-4529-b757-75d62f30b463 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:45.338704 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-47b7c981-510b-4529-b757-75d62f30b463 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.350996 Aug 26 11:05:45.339911 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 77/170] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:44 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:46.366197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d55574fa-f5a3-4c00-a215-3b57169489f6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:46.368431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d55574fa-f5a3-4c00-a215-3b57169489f6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:46.376996 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d55574fa-f5a3-4c00-a215-3b57169489f6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:46.377797 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d55574fa-f5a3-4c00-a215-3b57169489f6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:46.378876 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d55574fa-f5a3-4c00-a215-3b57169489f6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:46.380002 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d55574fa-f5a3-4c00-a215-3b57169489f6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:46.380878 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d55574fa-f5a3-4c00-a215-3b57169489f6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:46.382234 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d55574fa-f5a3-4c00-a215-3b57169489f6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:46.713176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-958a6a8b-8a86-4ea1-af6f-87d81206fb9d req-f83b9b32-3d54-4f82-99a2-081d63df76db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcad555f-f60b-409e-9075-f4fcdbbba3fe", "tag": "65e305ab-f815-483f-8ea8-1d853476bc95"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:46.731995 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-958a6a8b-8a86-4ea1-af6f-87d81206fb9d req-f83b9b32-3d54-4f82-99a2-081d63df76db service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:46.732719 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-958a6a8b-8a86-4ea1-af6f-87d81206fb9d req-f83b9b32-3d54-4f82-99a2-081d63df76db service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:46.733297 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-958a6a8b-8a86-4ea1-af6f-87d81206fb9d req-f83b9b32-3d54-4f82-99a2-081d63df76db service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:46.755060 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-958a6a8b-8a86-4ea1-af6f-87d81206fb9d req-f83b9b32-3d54-4f82-99a2-081d63df76db service nova] Creating event network-changed:65e305ab-f815-483f-8ea8-1d853476bc95 for instance fcad555f-f60b-409e-9075-f4fcdbbba3fe on hv-cinder-85236 Aug 26 11:05:46.755205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d55574fa-f5a3-4c00-a215-3b57169489f6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:46.762399 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-958a6a8b-8a86-4ea1-af6f-87d81206fb9d req-f83b9b32-3d54-4f82-99a2-081d63df76db service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053896 Aug 26 11:05:46.763159 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 78/171] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:05:46.769405 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d55574fa-f5a3-4c00-a215-3b57169489f6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.412621 Aug 26 11:05:46.770004 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 94/172] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:46 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:47.801369 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-11e61894-9370-4f08-a92d-08e590cbdef1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:47.803839 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-11e61894-9370-4f08-a92d-08e590cbdef1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:47.812561 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-11e61894-9370-4f08-a92d-08e590cbdef1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:47.813435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-11e61894-9370-4f08-a92d-08e590cbdef1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:47.814139 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-11e61894-9370-4f08-a92d-08e590cbdef1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:47.815179 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-11e61894-9370-4f08-a92d-08e590cbdef1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:47.815832 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-11e61894-9370-4f08-a92d-08e590cbdef1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:47.818282 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-11e61894-9370-4f08-a92d-08e590cbdef1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:48.025796 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-11e61894-9370-4f08-a92d-08e590cbdef1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:48.039308 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-11e61894-9370-4f08-a92d-08e590cbdef1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.247999 Aug 26 11:05:48.040544 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 79/173] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:47 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:49.061402 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-aae0132b-46bf-4189-86d2-3d472e5a4c52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:49.062033 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-aae0132b-46bf-4189-86d2-3d472e5a4c52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:49.070735 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aae0132b-46bf-4189-86d2-3d472e5a4c52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:49.071435 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aae0132b-46bf-4189-86d2-3d472e5a4c52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:49.072414 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aae0132b-46bf-4189-86d2-3d472e5a4c52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:49.073324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aae0132b-46bf-4189-86d2-3d472e5a4c52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:49.074008 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aae0132b-46bf-4189-86d2-3d472e5a4c52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:49.074649 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aae0132b-46bf-4189-86d2-3d472e5a4c52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:49.316835 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-aae0132b-46bf-4189-86d2-3d472e5a4c52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:49.327003 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-aae0132b-46bf-4189-86d2-3d472e5a4c52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.269212 Aug 26 11:05:49.329109 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 95/174] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:49 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:50.350853 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-cf1e23c2-c921-4118-87c2-55fe598eef89 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:50.352285 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-cf1e23c2-c921-4118-87c2-55fe598eef89 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:50.358640 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf1e23c2-c921-4118-87c2-55fe598eef89 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:50.359302 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf1e23c2-c921-4118-87c2-55fe598eef89 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:50.359837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf1e23c2-c921-4118-87c2-55fe598eef89 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:50.360770 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf1e23c2-c921-4118-87c2-55fe598eef89 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:50.361452 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf1e23c2-c921-4118-87c2-55fe598eef89 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:50.361989 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf1e23c2-c921-4118-87c2-55fe598eef89 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:50.572727 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-cf1e23c2-c921-4118-87c2-55fe598eef89 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:50.581773 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-cf1e23c2-c921-4118-87c2-55fe598eef89 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.236516 Aug 26 11:05:50.582455 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 80/175] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:50 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:51.603490 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9aa3e3f5-5beb-4c1b-8b1f-29ec44caeb9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:51.604203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9aa3e3f5-5beb-4c1b-8b1f-29ec44caeb9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:51.610222 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9aa3e3f5-5beb-4c1b-8b1f-29ec44caeb9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:51.610709 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9aa3e3f5-5beb-4c1b-8b1f-29ec44caeb9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:51.611158 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9aa3e3f5-5beb-4c1b-8b1f-29ec44caeb9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:51.611888 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9aa3e3f5-5beb-4c1b-8b1f-29ec44caeb9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:51.612340 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9aa3e3f5-5beb-4c1b-8b1f-29ec44caeb9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:51.612757 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9aa3e3f5-5beb-4c1b-8b1f-29ec44caeb9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:51.738882 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9aa3e3f5-5beb-4c1b-8b1f-29ec44caeb9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:51.747371 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9aa3e3f5-5beb-4c1b-8b1f-29ec44caeb9b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.147756 Aug 26 11:05:51.747959 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 96/176] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:51 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:52.769230 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-d95509e8-1990-4085-9759-695243741359 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:52.770231 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-d95509e8-1990-4085-9759-695243741359 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:52.778582 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d95509e8-1990-4085-9759-695243741359 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:52.778582 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d95509e8-1990-4085-9759-695243741359 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:52.778943 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d95509e8-1990-4085-9759-695243741359 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:52.780229 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d95509e8-1990-4085-9759-695243741359 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:52.781928 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d95509e8-1990-4085-9759-695243741359 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:52.785210 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d95509e8-1990-4085-9759-695243741359 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:52.933174 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-d95509e8-1990-4085-9759-695243741359 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:52.940830 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-d95509e8-1990-4085-9759-695243741359 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.175905 Aug 26 11:05:52.941410 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 81/177] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:52 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:53.964858 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-16205889-9047-4ffd-8887-e049ef0ae46d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:53.966169 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-16205889-9047-4ffd-8887-e049ef0ae46d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:53.976826 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16205889-9047-4ffd-8887-e049ef0ae46d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:53.977341 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16205889-9047-4ffd-8887-e049ef0ae46d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:53.977940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16205889-9047-4ffd-8887-e049ef0ae46d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:53.978839 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16205889-9047-4ffd-8887-e049ef0ae46d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:53.979429 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16205889-9047-4ffd-8887-e049ef0ae46d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:53.979992 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16205889-9047-4ffd-8887-e049ef0ae46d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:54.089137 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b6fc804c-9a30-4ec6-af64-5f310ba7fd0f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:54.089854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b6fc804c-9a30-4ec6-af64-5f310ba7fd0f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:54.096004 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6fc804c-9a30-4ec6-af64-5f310ba7fd0f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:54.096500 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6fc804c-9a30-4ec6-af64-5f310ba7fd0f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:54.096939 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6fc804c-9a30-4ec6-af64-5f310ba7fd0f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:54.097636 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6fc804c-9a30-4ec6-af64-5f310ba7fd0f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:54.098117 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6fc804c-9a30-4ec6-af64-5f310ba7fd0f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:54.098543 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6fc804c-9a30-4ec6-af64-5f310ba7fd0f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:54.124465 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-16205889-9047-4ffd-8887-e049ef0ae46d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:54.124973 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b6fc804c-9a30-4ec6-af64-5f310ba7fd0f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Going to try to terminate instance {{(pid=120605) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:05:54.132758 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-16205889-9047-4ffd-8887-e049ef0ae46d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.174678 Aug 26 11:05:54.133536 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 97/178] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:53 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:54.221354 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b6fc804c-9a30-4ec6-af64-5f310ba7fd0f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "DELETE /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 204 len: 0 microversion: 2.1 time: 0.135989 Aug 26 11:05:54.221948 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 82/179] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:05:54 2022] DELETE /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 11:05:54.231796 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c636d057-3854-46f1-851f-30e899472cb1 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:54.232572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c636d057-3854-46f1-851f-30e899472cb1 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:54.238971 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c636d057-3854-46f1-851f-30e899472cb1 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:54.239693 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c636d057-3854-46f1-851f-30e899472cb1 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:54.240386 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c636d057-3854-46f1-851f-30e899472cb1 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:54.241232 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c636d057-3854-46f1-851f-30e899472cb1 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:54.241862 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c636d057-3854-46f1-851f-30e899472cb1 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:54.242732 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c636d057-3854-46f1-851f-30e899472cb1 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:54.411045 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c636d057-3854-46f1-851f-30e899472cb1 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:54.424477 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c636d057-3854-46f1-851f-30e899472cb1 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1554 microversion: 2.1 time: 0.197432 Aug 26 11:05:54.425328 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 98/180] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:54 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1554 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:55.153896 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-9964417d-1cc7-427d-bddd-66c96f1c2243 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:55.154858 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9964417d-1cc7-427d-bddd-66c96f1c2243 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:55.163138 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9964417d-1cc7-427d-bddd-66c96f1c2243 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:55.163772 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9964417d-1cc7-427d-bddd-66c96f1c2243 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:55.164338 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9964417d-1cc7-427d-bddd-66c96f1c2243 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:55.166161 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9964417d-1cc7-427d-bddd-66c96f1c2243 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:55.166737 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9964417d-1cc7-427d-bddd-66c96f1c2243 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:55.167221 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9964417d-1cc7-427d-bddd-66c96f1c2243 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:55.316436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9964417d-1cc7-427d-bddd-66c96f1c2243 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:55.325005 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-9964417d-1cc7-427d-bddd-66c96f1c2243 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.175109 Aug 26 11:05:55.325637 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 83/181] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:55 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:55.446479 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-79ff5efd-0010-4220-a4bf-1c97461bf939 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:55.447095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-79ff5efd-0010-4220-a4bf-1c97461bf939 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:55.453365 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79ff5efd-0010-4220-a4bf-1c97461bf939 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:55.453856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79ff5efd-0010-4220-a4bf-1c97461bf939 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:55.454321 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79ff5efd-0010-4220-a4bf-1c97461bf939 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:55.455018 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79ff5efd-0010-4220-a4bf-1c97461bf939 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:55.455472 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79ff5efd-0010-4220-a4bf-1c97461bf939 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:55.455897 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79ff5efd-0010-4220-a4bf-1c97461bf939 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:55.581192 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-79ff5efd-0010-4220-a4bf-1c97461bf939 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:55.589967 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-79ff5efd-0010-4220-a4bf-1c97461bf939 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1554 microversion: 2.1 time: 0.147971 Aug 26 11:05:55.590553 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 99/182] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:55 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:56.344668 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-34caea7b-af88-4406-b4bc-8a1515af4483 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:56.345423 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-34caea7b-af88-4406-b4bc-8a1515af4483 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:56.352868 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-34caea7b-af88-4406-b4bc-8a1515af4483 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:56.353359 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-34caea7b-af88-4406-b4bc-8a1515af4483 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:56.353793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-34caea7b-af88-4406-b4bc-8a1515af4483 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:56.354516 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-34caea7b-af88-4406-b4bc-8a1515af4483 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:56.354966 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-34caea7b-af88-4406-b4bc-8a1515af4483 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:56.355390 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-34caea7b-af88-4406-b4bc-8a1515af4483 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:56.484378 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-34caea7b-af88-4406-b4bc-8a1515af4483 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:56.486309 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:05:56.493359 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-34caea7b-af88-4406-b4bc-8a1515af4483 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.152648 Aug 26 11:05:56.493937 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 84/183] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:56 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:56.611446 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e8beb5ff-e643-4c25-8014-ab60510c3521 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:56.611980 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e8beb5ff-e643-4c25-8014-ab60510c3521 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:56.619065 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e8beb5ff-e643-4c25-8014-ab60510c3521 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:56.619554 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e8beb5ff-e643-4c25-8014-ab60510c3521 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:56.619993 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e8beb5ff-e643-4c25-8014-ab60510c3521 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:56.620690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e8beb5ff-e643-4c25-8014-ab60510c3521 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:56.621145 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e8beb5ff-e643-4c25-8014-ab60510c3521 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:56.621572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e8beb5ff-e643-4c25-8014-ab60510c3521 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:56.750157 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e8beb5ff-e643-4c25-8014-ab60510c3521 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:56.759267 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e8beb5ff-e643-4c25-8014-ab60510c3521 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1554 microversion: 2.1 time: 0.151825 Aug 26 11:05:56.759822 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 100/184] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:56 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:57.518532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-630bc50b-a66b-450a-80b4-ea2658a66e51 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:57.519147 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-630bc50b-a66b-450a-80b4-ea2658a66e51 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:57.529241 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-630bc50b-a66b-450a-80b4-ea2658a66e51 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:57.529718 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-630bc50b-a66b-450a-80b4-ea2658a66e51 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:57.530218 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-630bc50b-a66b-450a-80b4-ea2658a66e51 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:57.530880 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-630bc50b-a66b-450a-80b4-ea2658a66e51 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:57.531374 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-630bc50b-a66b-450a-80b4-ea2658a66e51 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:57.531856 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-630bc50b-a66b-450a-80b4-ea2658a66e51 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:57.663657 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-630bc50b-a66b-450a-80b4-ea2658a66e51 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:57.671318 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-630bc50b-a66b-450a-80b4-ea2658a66e51 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.160413 Aug 26 11:05:57.671890 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 85/185] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:57 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:57.780820 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1d6ed035-3369-4f63-9cc8-bfb131db871f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:57.781454 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1d6ed035-3369-4f63-9cc8-bfb131db871f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:57.787362 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d6ed035-3369-4f63-9cc8-bfb131db871f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:57.787840 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d6ed035-3369-4f63-9cc8-bfb131db871f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:57.788270 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d6ed035-3369-4f63-9cc8-bfb131db871f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:57.788954 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d6ed035-3369-4f63-9cc8-bfb131db871f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:57.789399 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d6ed035-3369-4f63-9cc8-bfb131db871f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:57.789813 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d6ed035-3369-4f63-9cc8-bfb131db871f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:57.920855 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1d6ed035-3369-4f63-9cc8-bfb131db871f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:57.929552 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1d6ed035-3369-4f63-9cc8-bfb131db871f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1554 microversion: 2.1 time: 0.152495 Aug 26 11:05:57.930151 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 101/186] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:57 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:58.692041 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-728bd02f-0a8c-4207-aeaf-1ef932d441ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:58.692647 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-728bd02f-0a8c-4207-aeaf-1ef932d441ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:58.699448 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-728bd02f-0a8c-4207-aeaf-1ef932d441ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:58.699932 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-728bd02f-0a8c-4207-aeaf-1ef932d441ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:58.700370 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-728bd02f-0a8c-4207-aeaf-1ef932d441ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:58.701070 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-728bd02f-0a8c-4207-aeaf-1ef932d441ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:58.701526 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-728bd02f-0a8c-4207-aeaf-1ef932d441ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:58.701949 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-728bd02f-0a8c-4207-aeaf-1ef932d441ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:58.838143 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-728bd02f-0a8c-4207-aeaf-1ef932d441ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:58.845675 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-728bd02f-0a8c-4207-aeaf-1ef932d441ce tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.157626 Aug 26 11:05:58.846265 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 86/187] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:58 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:58.951375 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e84e71a7-802c-4f5e-b2dc-5551fb7a811e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:58.952607 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e84e71a7-802c-4f5e-b2dc-5551fb7a811e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:58.959406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e84e71a7-802c-4f5e-b2dc-5551fb7a811e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:58.959935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e84e71a7-802c-4f5e-b2dc-5551fb7a811e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:58.960342 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e84e71a7-802c-4f5e-b2dc-5551fb7a811e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:58.961028 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e84e71a7-802c-4f5e-b2dc-5551fb7a811e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:58.961555 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e84e71a7-802c-4f5e-b2dc-5551fb7a811e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:58.961880 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e84e71a7-802c-4f5e-b2dc-5551fb7a811e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:59.212196 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e84e71a7-802c-4f5e-b2dc-5551fb7a811e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:05:59.220889 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e84e71a7-802c-4f5e-b2dc-5551fb7a811e tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1554 microversion: 2.1 time: 0.273672 Aug 26 11:05:59.234352 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 102/188] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:58 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1554 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:05:59.511124 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-2eb1c261-ffda-4d5f-b997-ed6ac4e7ef1c req-700e8fc3-1e7f-4559-9fcd-ac2fc513c712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04076a90-f7d2-4295-a167-5eab08bfdf37", "name": "network-vif-deleted", "tag": "25f6fa0a-7f42-4b62-acf1-e6c9ee0ad2ad"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:05:59.522596 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-2eb1c261-ffda-4d5f-b997-ed6ac4e7ef1c req-700e8fc3-1e7f-4559-9fcd-ac2fc513c712 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:59.523561 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-2eb1c261-ffda-4d5f-b997-ed6ac4e7ef1c req-700e8fc3-1e7f-4559-9fcd-ac2fc513c712 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:59.524197 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-2eb1c261-ffda-4d5f-b997-ed6ac4e7ef1c req-700e8fc3-1e7f-4559-9fcd-ac2fc513c712 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:59.542720 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-2eb1c261-ffda-4d5f-b997-ed6ac4e7ef1c req-700e8fc3-1e7f-4559-9fcd-ac2fc513c712 service nova] Creating event network-vif-deleted:25f6fa0a-7f42-4b62-acf1-e6c9ee0ad2ad for instance 04076a90-f7d2-4295-a167-5eab08bfdf37 on hv-cinder-85236 Aug 26 11:05:59.549003 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-2eb1c261-ffda-4d5f-b997-ed6ac4e7ef1c req-700e8fc3-1e7f-4559-9fcd-ac2fc513c712 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041933 Aug 26 11:05:59.550264 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 87/189] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:05:59.869828 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b7abfeb0-9ba3-40da-b66e-fbb3413c17e6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:05:59.870480 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b7abfeb0-9ba3-40da-b66e-fbb3413c17e6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:05:59.876584 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b7abfeb0-9ba3-40da-b66e-fbb3413c17e6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:59.877072 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b7abfeb0-9ba3-40da-b66e-fbb3413c17e6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:59.877514 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b7abfeb0-9ba3-40da-b66e-fbb3413c17e6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:05:59.878239 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b7abfeb0-9ba3-40da-b66e-fbb3413c17e6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:05:59.878703 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b7abfeb0-9ba3-40da-b66e-fbb3413c17e6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:05:59.879164 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b7abfeb0-9ba3-40da-b66e-fbb3413c17e6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:00.035656 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b7abfeb0-9ba3-40da-b66e-fbb3413c17e6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:00.046390 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b7abfeb0-9ba3-40da-b66e-fbb3413c17e6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.180677 Aug 26 11:06:00.047015 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 103/190] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:05:59 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:00.242835 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0827da44-0ebb-4768-9ebf-4d1e148e1e60 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:00.243676 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0827da44-0ebb-4768-9ebf-4d1e148e1e60 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:00.250311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0827da44-0ebb-4768-9ebf-4d1e148e1e60 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:00.250979 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0827da44-0ebb-4768-9ebf-4d1e148e1e60 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:00.251412 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0827da44-0ebb-4768-9ebf-4d1e148e1e60 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:00.252098 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0827da44-0ebb-4768-9ebf-4d1e148e1e60 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:00.252539 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0827da44-0ebb-4768-9ebf-4d1e148e1e60 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:00.252954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0827da44-0ebb-4768-9ebf-4d1e148e1e60 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:00.319246 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0827da44-0ebb-4768-9ebf-4d1e148e1e60 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:00.327813 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0827da44-0ebb-4768-9ebf-4d1e148e1e60 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1512 microversion: 2.1 time: 0.089565 Aug 26 11:06:00.328505 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 88/191] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:00 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1512 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:01.067694 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-29ab880a-60a5-4fbf-a037-3b119997ae9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:01.068247 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-29ab880a-60a5-4fbf-a037-3b119997ae9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:01.074177 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-29ab880a-60a5-4fbf-a037-3b119997ae9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:01.074664 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-29ab880a-60a5-4fbf-a037-3b119997ae9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:01.075126 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-29ab880a-60a5-4fbf-a037-3b119997ae9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:01.075814 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-29ab880a-60a5-4fbf-a037-3b119997ae9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:01.076263 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-29ab880a-60a5-4fbf-a037-3b119997ae9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:01.076678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-29ab880a-60a5-4fbf-a037-3b119997ae9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:01.224927 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-29ab880a-60a5-4fbf-a037-3b119997ae9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:01.232817 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-29ab880a-60a5-4fbf-a037-3b119997ae9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.169133 Aug 26 11:06:01.233589 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 104/192] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:01 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:01.350069 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-2114c660-e11f-4131-a237-ea8250aa63a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:01.350684 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-2114c660-e11f-4131-a237-ea8250aa63a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:01.357048 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2114c660-e11f-4131-a237-ea8250aa63a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:01.357523 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2114c660-e11f-4131-a237-ea8250aa63a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:01.357953 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2114c660-e11f-4131-a237-ea8250aa63a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:01.358656 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2114c660-e11f-4131-a237-ea8250aa63a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:01.359104 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2114c660-e11f-4131-a237-ea8250aa63a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:01.359522 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2114c660-e11f-4131-a237-ea8250aa63a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:01.427267 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-2114c660-e11f-4131-a237-ea8250aa63a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:01.435544 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-2114c660-e11f-4131-a237-ea8250aa63a0 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1346 microversion: 2.1 time: 0.090631 Aug 26 11:06:01.436116 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 89/193] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:01 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:02.256124 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-054b6511-b254-4d1b-a9f3-1b502fa470ea tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:02.256850 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-054b6511-b254-4d1b-a9f3-1b502fa470ea tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:02.263946 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-054b6511-b254-4d1b-a9f3-1b502fa470ea tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:02.264504 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-054b6511-b254-4d1b-a9f3-1b502fa470ea tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:02.265017 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-054b6511-b254-4d1b-a9f3-1b502fa470ea tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:02.265800 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-054b6511-b254-4d1b-a9f3-1b502fa470ea tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:02.266657 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-054b6511-b254-4d1b-a9f3-1b502fa470ea tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:02.267289 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-054b6511-b254-4d1b-a9f3-1b502fa470ea tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:02.456261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-d44b399e-b841-4235-8b0e-0eaf96d2d502 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:02.456943 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-d44b399e-b841-4235-8b0e-0eaf96d2d502 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:02.463693 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d44b399e-b841-4235-8b0e-0eaf96d2d502 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:02.464169 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d44b399e-b841-4235-8b0e-0eaf96d2d502 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:02.464601 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d44b399e-b841-4235-8b0e-0eaf96d2d502 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:02.465312 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d44b399e-b841-4235-8b0e-0eaf96d2d502 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:02.465760 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d44b399e-b841-4235-8b0e-0eaf96d2d502 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:02.466229 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d44b399e-b841-4235-8b0e-0eaf96d2d502 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:02.627809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-d44b399e-b841-4235-8b0e-0eaf96d2d502 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:02.636742 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-d44b399e-b841-4235-8b0e-0eaf96d2d502 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1346 microversion: 2.1 time: 0.184418 Aug 26 11:06:02.637308 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 90/194] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:02 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:06:02.643955 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-054b6511-b254-4d1b-a9f3-1b502fa470ea tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:02.651608 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-054b6511-b254-4d1b-a9f3-1b502fa470ea tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.399910 Aug 26 11:06:02.652159 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 105/195] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:02 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:03.657422 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-2ec09b92-0b12-4b13-b398-c03f4e521d8d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:03.658007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-2ec09b92-0b12-4b13-b398-c03f4e521d8d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:03.665920 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2ec09b92-0b12-4b13-b398-c03f4e521d8d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:03.666431 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2ec09b92-0b12-4b13-b398-c03f4e521d8d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:03.667027 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2ec09b92-0b12-4b13-b398-c03f4e521d8d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:03.668111 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2ec09b92-0b12-4b13-b398-c03f4e521d8d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:03.668749 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2ec09b92-0b12-4b13-b398-c03f4e521d8d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:03.669125 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2ec09b92-0b12-4b13-b398-c03f4e521d8d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:03.673096 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6d75dc70-b541-4676-9bf8-c8e28bae308c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:03.673716 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6d75dc70-b541-4676-9bf8-c8e28bae308c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:03.682776 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6d75dc70-b541-4676-9bf8-c8e28bae308c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:03.684664 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6d75dc70-b541-4676-9bf8-c8e28bae308c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:03.685502 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6d75dc70-b541-4676-9bf8-c8e28bae308c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:03.687440 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6d75dc70-b541-4676-9bf8-c8e28bae308c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:03.687960 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6d75dc70-b541-4676-9bf8-c8e28bae308c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:03.688392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6d75dc70-b541-4676-9bf8-c8e28bae308c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:03.701775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2ec09b92-0b12-4b13-b398-c03f4e521d8d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:03.702230 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2ec09b92-0b12-4b13-b398-c03f4e521d8d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:03.702660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2ec09b92-0b12-4b13-b398-c03f4e521d8d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:03.703118 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-2ec09b92-0b12-4b13-b398-c03f4e521d8d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lazy-loading 'fault' on Instance uuid 04076a90-f7d2-4295-a167-5eab08bfdf37 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:06:03.758240 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-2ec09b92-0b12-4b13-b398-c03f4e521d8d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:03.766081 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-2ec09b92-0b12-4b13-b398-c03f4e521d8d tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1351 microversion: 2.1 time: 0.113302 Aug 26 11:06:03.766665 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 91/196] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:03 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:03.855321 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6d75dc70-b541-4676-9bf8-c8e28bae308c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:03.867791 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6d75dc70-b541-4676-9bf8-c8e28bae308c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.198590 Aug 26 11:06:03.868779 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 106/197] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:03 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:06:04.796171 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-44ac6227-fa9e-4a6a-9722-5ca2c1d1cec9 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:04.796815 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-44ac6227-fa9e-4a6a-9722-5ca2c1d1cec9 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:04.805424 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-44ac6227-fa9e-4a6a-9722-5ca2c1d1cec9 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:04.805914 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-44ac6227-fa9e-4a6a-9722-5ca2c1d1cec9 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:04.806374 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-44ac6227-fa9e-4a6a-9722-5ca2c1d1cec9 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:04.807085 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-44ac6227-fa9e-4a6a-9722-5ca2c1d1cec9 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:04.807507 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-44ac6227-fa9e-4a6a-9722-5ca2c1d1cec9 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:04.807994 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-44ac6227-fa9e-4a6a-9722-5ca2c1d1cec9 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:04.838214 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-44ac6227-fa9e-4a6a-9722-5ca2c1d1cec9 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:04.838695 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-44ac6227-fa9e-4a6a-9722-5ca2c1d1cec9 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:04.839128 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-44ac6227-fa9e-4a6a-9722-5ca2c1d1cec9 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:04.839565 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-44ac6227-fa9e-4a6a-9722-5ca2c1d1cec9 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lazy-loading 'fault' on Instance uuid 04076a90-f7d2-4295-a167-5eab08bfdf37 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:06:04.880133 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-44ac6227-fa9e-4a6a-9722-5ca2c1d1cec9 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:04.889034 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-44ac6227-fa9e-4a6a-9722-5ca2c1d1cec9 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1351 microversion: 2.1 time: 0.096619 Aug 26 11:06:04.889234 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9beb80b4-d9ac-488d-abe5-f42729bf7856 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:04.891763 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 92/198] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:04 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:04.891901 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9beb80b4-d9ac-488d-abe5-f42729bf7856 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:04.896482 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9beb80b4-d9ac-488d-abe5-f42729bf7856 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:04.897055 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9beb80b4-d9ac-488d-abe5-f42729bf7856 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:04.897615 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9beb80b4-d9ac-488d-abe5-f42729bf7856 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:04.898410 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9beb80b4-d9ac-488d-abe5-f42729bf7856 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:04.898946 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9beb80b4-d9ac-488d-abe5-f42729bf7856 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:04.899446 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9beb80b4-d9ac-488d-abe5-f42729bf7856 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:05.034305 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9beb80b4-d9ac-488d-abe5-f42729bf7856 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:05.042627 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9beb80b4-d9ac-488d-abe5-f42729bf7856 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.157430 Aug 26 11:06:05.043200 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 107/199] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:04 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:06:05.909798 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-05689b43-27a7-47fa-a101-9b9c6c894ffe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:05.910441 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-05689b43-27a7-47fa-a101-9b9c6c894ffe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:05.916969 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-05689b43-27a7-47fa-a101-9b9c6c894ffe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:05.917450 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-05689b43-27a7-47fa-a101-9b9c6c894ffe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:05.917883 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-05689b43-27a7-47fa-a101-9b9c6c894ffe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:05.918666 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-05689b43-27a7-47fa-a101-9b9c6c894ffe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:05.919116 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-05689b43-27a7-47fa-a101-9b9c6c894ffe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:05.919541 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-05689b43-27a7-47fa-a101-9b9c6c894ffe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:05.951963 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-05689b43-27a7-47fa-a101-9b9c6c894ffe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:05.952360 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-05689b43-27a7-47fa-a101-9b9c6c894ffe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:05.952792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-05689b43-27a7-47fa-a101-9b9c6c894ffe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:05.953224 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-05689b43-27a7-47fa-a101-9b9c6c894ffe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lazy-loading 'fault' on Instance uuid 04076a90-f7d2-4295-a167-5eab08bfdf37 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:06:05.992045 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-05689b43-27a7-47fa-a101-9b9c6c894ffe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd074367ea693406badce6f7b468f3147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a00e426be1a41b4b37f7825869ac5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:06.000327 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-05689b43-27a7-47fa-a101-9b9c6c894ffe tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 200 len: 1351 microversion: 2.1 time: 0.094346 Aug 26 11:06:06.000920 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 93/200] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:05 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:06.067024 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b9cf4614-e5b2-4caf-ad8a-e20bb229489f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:06.067761 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b9cf4614-e5b2-4caf-ad8a-e20bb229489f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:06.074286 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b9cf4614-e5b2-4caf-ad8a-e20bb229489f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:06.074774 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b9cf4614-e5b2-4caf-ad8a-e20bb229489f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:06.075195 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b9cf4614-e5b2-4caf-ad8a-e20bb229489f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:06.075879 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b9cf4614-e5b2-4caf-ad8a-e20bb229489f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:06.076335 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b9cf4614-e5b2-4caf-ad8a-e20bb229489f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:06.076756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b9cf4614-e5b2-4caf-ad8a-e20bb229489f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:06.079320 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=100 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:06:06.207236 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b9cf4614-e5b2-4caf-ad8a-e20bb229489f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:06.214883 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b9cf4614-e5b2-4caf-ad8a-e20bb229489f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.154637 Aug 26 11:06:06.215447 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 108/201] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:06 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:07.021291 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-389d62e8-0229-422d-b3cd-c420ed9b8d80 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:07.021893 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-389d62e8-0229-422d-b3cd-c420ed9b8d80 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:07.028247 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-389d62e8-0229-422d-b3cd-c420ed9b8d80 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:07.028719 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-389d62e8-0229-422d-b3cd-c420ed9b8d80 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:07.029155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-389d62e8-0229-422d-b3cd-c420ed9b8d80 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:07.029831 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-389d62e8-0229-422d-b3cd-c420ed9b8d80 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:07.030309 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-389d62e8-0229-422d-b3cd-c420ed9b8d80 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:07.030723 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-389d62e8-0229-422d-b3cd-c420ed9b8d80 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:07.044397 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-389d62e8-0229-422d-b3cd-c420ed9b8d80 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] HTTP exception thrown: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-389d62e8-0229-422d-b3cd-c420ed9b8d80 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Request method failure captured: Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 HTTP/1.1 Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKjOSSTqmOWncwibk6p6YF18zO_T7O1OtocojCHNOpeUBIGmR2UO8lD-FQkm3TN-RfwkLcbnlBCchyB-rmlOpURs3k1dZ9oynQbenV73lRywTGYjICIeufBC0EXXyUX9V-FMnLEzHQS-6O6EtKn1ZkSorhLN1zxCdwusVwfoCASpVAE Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: 6a00e426be1a41b4b37f7825869ac5cb Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-DeleteServersTestJSON-1927575620 Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:06:07.057436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:06:07.058882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6a00e426be1a41b4b37f7825869ac5cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6a00e426be1a41b4b37f7825869ac5cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6a00e426be1a41b4b37f7825869ac5cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6a00e426be1a41b4b37f7825869ac5cb"}]}] Aug 26 11:06:07.058882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-DeleteServersTestJSON-1927575620 Aug 26 11:06:07.058882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: 6a00e426be1a41b4b37f7825869ac5cb Aug 26 11:06:07.058882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-DeleteServersTestJSON-1927575620 Aug 26 11:06:07.058882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-DeleteServersTestJSON-1927575620-project Aug 26 11:06:07.058882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:06:07.058882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:06:07.058882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: d074367ea693406badce6f7b468f3147 Aug 26 11:06:07.058882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-DeleteServersTestJSON-1927575620-project Aug 26 11:06:07.058882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:06:07.058882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:07.058882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': '04076a90-f7d2-4295-a167-5eab08bfdf37'} Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:06:07.059677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:07.061007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:07.062193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-389d62e8-0229-422d-b3cd-c420ed9b8d80 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Returning 404 to user: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:06:07.062193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-389d62e8-0229-422d-b3cd-c420ed9b8d80 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 404 len: 111 microversion: 2.1 time: 0.041557 Aug 26 11:06:07.062193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 94/202] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:07 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:06:07.170356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5cfd2f6e-adda-4805-b852-3e70be50746f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:07.172735 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5cfd2f6e-adda-4805-b852-3e70be50746f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:07.179961 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cfd2f6e-adda-4805-b852-3e70be50746f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:07.180607 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cfd2f6e-adda-4805-b852-3e70be50746f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:07.181060 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cfd2f6e-adda-4805-b852-3e70be50746f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:07.182087 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cfd2f6e-adda-4805-b852-3e70be50746f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:07.182622 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cfd2f6e-adda-4805-b852-3e70be50746f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:07.183597 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cfd2f6e-adda-4805-b852-3e70be50746f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:07.199035 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-5cfd2f6e-adda-4805-b852-3e70be50746f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] HTTP exception thrown: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5cfd2f6e-adda-4805-b852-3e70be50746f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Request method failure captured: Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37/os-volume_attachments HTTP/1.1 Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKjOSSTqmOWncwibk6p6YF18zO_T7O1OtocojCHNOpeUBIGmR2UO8lD-FQkm3TN-RfwkLcbnlBCchyB-rmlOpURs3k1dZ9oynQbenV73lRywTGYjICIeufBC0EXXyUX9V-FMnLEzHQS-6O6EtKn1ZkSorhLN1zxCdwusVwfoCASpVAE Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: 6a00e426be1a41b4b37f7825869ac5cb Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-DeleteServersTestJSON-1927575620 Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:06:07.203146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:06:07.204383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6a00e426be1a41b4b37f7825869ac5cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6a00e426be1a41b4b37f7825869ac5cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6a00e426be1a41b4b37f7825869ac5cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6a00e426be1a41b4b37f7825869ac5cb"}]}] Aug 26 11:06:07.204383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-DeleteServersTestJSON-1927575620 Aug 26 11:06:07.204383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 6a00e426be1a41b4b37f7825869ac5cb Aug 26 11:06:07.204383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-DeleteServersTestJSON-1927575620 Aug 26 11:06:07.204383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-DeleteServersTestJSON-1927575620-project Aug 26 11:06:07.204383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:06:07.204383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:06:07.204383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: d074367ea693406badce6f7b468f3147 Aug 26 11:06:07.204383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-DeleteServersTestJSON-1927575620-project Aug 26 11:06:07.204383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:06:07.204383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:07.204383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'server_id': '04076a90-f7d2-4295-a167-5eab08bfdf37'} Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:06:07.205095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:07.206585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:06:07.209523 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5cfd2f6e-adda-4805-b852-3e70be50746f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Returning 404 to user: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:06:07.210747 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5cfd2f6e-adda-4805-b852-3e70be50746f tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044458 Aug 26 11:06:07.211469 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 109/203] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:06:07 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:06:07.237315 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-faefb7c4-5018-4365-bfd1-9bc6c4af9ea3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:07.238075 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-faefb7c4-5018-4365-bfd1-9bc6c4af9ea3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:07.248412 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-faefb7c4-5018-4365-bfd1-9bc6c4af9ea3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:07.248412 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-faefb7c4-5018-4365-bfd1-9bc6c4af9ea3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:07.248837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-faefb7c4-5018-4365-bfd1-9bc6c4af9ea3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:07.250732 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-faefb7c4-5018-4365-bfd1-9bc6c4af9ea3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:07.251371 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-faefb7c4-5018-4365-bfd1-9bc6c4af9ea3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:07.251804 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-faefb7c4-5018-4365-bfd1-9bc6c4af9ea3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:07.453433 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-faefb7c4-5018-4365-bfd1-9bc6c4af9ea3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:07.473365 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-faefb7c4-5018-4365-bfd1-9bc6c4af9ea3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.238990 Aug 26 11:06:07.473959 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 95/204] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:07 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:08.497208 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-08555b7f-f195-49fa-b4df-52494f5b95fb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:08.497823 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-08555b7f-f195-49fa-b4df-52494f5b95fb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:08.504030 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-08555b7f-f195-49fa-b4df-52494f5b95fb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:08.504529 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-08555b7f-f195-49fa-b4df-52494f5b95fb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:08.505089 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-08555b7f-f195-49fa-b4df-52494f5b95fb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:08.506455 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-08555b7f-f195-49fa-b4df-52494f5b95fb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:08.506911 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-08555b7f-f195-49fa-b4df-52494f5b95fb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:08.507335 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-08555b7f-f195-49fa-b4df-52494f5b95fb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:08.591202 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-96577850-2e9c-4521-b5fc-fc08026f9ae6 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:08.591800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-96577850-2e9c-4521-b5fc-fc08026f9ae6 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:08.599844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-96577850-2e9c-4521-b5fc-fc08026f9ae6 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:08.600878 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-96577850-2e9c-4521-b5fc-fc08026f9ae6 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:08.601502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-96577850-2e9c-4521-b5fc-fc08026f9ae6 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:08.602594 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-96577850-2e9c-4521-b5fc-fc08026f9ae6 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:08.603336 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-96577850-2e9c-4521-b5fc-fc08026f9ae6 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:08.603964 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-96577850-2e9c-4521-b5fc-fc08026f9ae6 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:08.623579 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-96577850-2e9c-4521-b5fc-fc08026f9ae6 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] HTTP exception thrown: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-96577850-2e9c-4521-b5fc-fc08026f9ae6 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Request method failure captured: Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: DELETE /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 HTTP/1.1 Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKjOSSTqmOWncwibk6p6YF18zO_T7O1OtocojCHNOpeUBIGmR2UO8lD-FQkm3TN-RfwkLcbnlBCchyB-rmlOpURs3k1dZ9oynQbenV73lRywTGYjICIeufBC0EXXyUX9V-FMnLEzHQS-6O6EtKn1ZkSorhLN1zxCdwusVwfoCASpVAE Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: 6a00e426be1a41b4b37f7825869ac5cb Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-DeleteServersTestJSON-1927575620 Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:06:08.626495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:06:08.627916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6a00e426be1a41b4b37f7825869ac5cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6a00e426be1a41b4b37f7825869ac5cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6a00e426be1a41b4b37f7825869ac5cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6a00e426be1a41b4b37f7825869ac5cb"}]}] Aug 26 11:06:08.627916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-DeleteServersTestJSON-1927575620 Aug 26 11:06:08.627916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: 6a00e426be1a41b4b37f7825869ac5cb Aug 26 11:06:08.627916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-DeleteServersTestJSON-1927575620 Aug 26 11:06:08.627916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-DeleteServersTestJSON-1927575620-project Aug 26 11:06:08.627916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:06:08.627916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:06:08.627916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: d074367ea693406badce6f7b468f3147 Aug 26 11:06:08.627916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-DeleteServersTestJSON-1927575620-project Aug 26 11:06:08.627916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:06:08.627916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:08.627916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': '04076a90-f7d2-4295-a167-5eab08bfdf37'} Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:06:08.628610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:08.629800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:08.631690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-96577850-2e9c-4521-b5fc-fc08026f9ae6 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Returning 404 to user: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:06:08.631690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-96577850-2e9c-4521-b5fc-fc08026f9ae6 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "DELETE /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 404 len: 111 microversion: 2.1 time: 0.044480 Aug 26 11:06:08.631690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 96/205] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:06:08 2022] DELETE /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 11:06:08.647391 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-21775d17-e38b-4c58-946f-4e607cf10401 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:08.648108 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-21775d17-e38b-4c58-946f-4e607cf10401 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] [instance: 04076a90-f7d2-4295-a167-5eab08bfdf37] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:08.654144 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-21775d17-e38b-4c58-946f-4e607cf10401 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:08.654623 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-21775d17-e38b-4c58-946f-4e607cf10401 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:08.655054 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-21775d17-e38b-4c58-946f-4e607cf10401 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:08.655741 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-21775d17-e38b-4c58-946f-4e607cf10401 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:08.656187 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-21775d17-e38b-4c58-946f-4e607cf10401 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:08.656767 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-21775d17-e38b-4c58-946f-4e607cf10401 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:08.672128 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-21775d17-e38b-4c58-946f-4e607cf10401 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] HTTP exception thrown: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-21775d17-e38b-4c58-946f-4e607cf10401 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Request method failure captured: Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 HTTP/1.1 Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKjOSSTqmOWncwibk6p6YF18zO_T7O1OtocojCHNOpeUBIGmR2UO8lD-FQkm3TN-RfwkLcbnlBCchyB-rmlOpURs3k1dZ9oynQbenV73lRywTGYjICIeufBC0EXXyUX9V-FMnLEzHQS-6O6EtKn1ZkSorhLN1zxCdwusVwfoCASpVAE Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: 6a00e426be1a41b4b37f7825869ac5cb Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-DeleteServersTestJSON-1927575620 Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:06:08.673660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:06:08.675110 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6a00e426be1a41b4b37f7825869ac5cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6a00e426be1a41b4b37f7825869ac5cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6a00e426be1a41b4b37f7825869ac5cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6a00e426be1a41b4b37f7825869ac5cb"}]}] Aug 26 11:06:08.675110 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-DeleteServersTestJSON-1927575620 Aug 26 11:06:08.675110 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: 6a00e426be1a41b4b37f7825869ac5cb Aug 26 11:06:08.675110 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-DeleteServersTestJSON-1927575620 Aug 26 11:06:08.675110 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-DeleteServersTestJSON-1927575620-project Aug 26 11:06:08.675110 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:06:08.675110 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:06:08.675110 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: d074367ea693406badce6f7b468f3147 Aug 26 11:06:08.675110 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-DeleteServersTestJSON-1927575620-project Aug 26 11:06:08.675110 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:06:08.675110 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:08.675110 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': '04076a90-f7d2-4295-a167-5eab08bfdf37'} Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:06:08.675860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. Aug 26 11:06:08.676907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:08.678516 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-21775d17-e38b-4c58-946f-4e607cf10401 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] Returning 404 to user: Instance 04076a90-f7d2-4295-a167-5eab08bfdf37 could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:06:08.678516 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-21775d17-e38b-4c58-946f-4e607cf10401 tempest-DeleteServersTestJSON-1927575620 tempest-DeleteServersTestJSON-1927575620-project] 10.222.0.40 "GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37" status: 404 len: 111 microversion: 2.1 time: 0.032266 Aug 26 11:06:08.678516 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 97/206] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:08 2022] GET /compute/v2.1/servers/04076a90-f7d2-4295-a167-5eab08bfdf37 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:06:08.738313 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-08555b7f-f195-49fa-b4df-52494f5b95fb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:08.749323 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-08555b7f-f195-49fa-b4df-52494f5b95fb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.256745 Aug 26 11:06:08.750002 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 110/207] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:08 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:09.775267 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c88d57ae-c0e9-49c9-bfe7-983b154b2e49 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:09.776629 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c88d57ae-c0e9-49c9-bfe7-983b154b2e49 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:09.790008 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c88d57ae-c0e9-49c9-bfe7-983b154b2e49 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:09.790542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c88d57ae-c0e9-49c9-bfe7-983b154b2e49 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:09.790989 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c88d57ae-c0e9-49c9-bfe7-983b154b2e49 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:09.793139 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c88d57ae-c0e9-49c9-bfe7-983b154b2e49 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:09.795025 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c88d57ae-c0e9-49c9-bfe7-983b154b2e49 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:09.795457 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c88d57ae-c0e9-49c9-bfe7-983b154b2e49 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:10.227380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c88d57ae-c0e9-49c9-bfe7-983b154b2e49 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:10.240424 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c88d57ae-c0e9-49c9-bfe7-983b154b2e49 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.472629 Aug 26 11:06:10.255441 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 98/208] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:09 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:11.266961 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d0a53da3-387e-4c77-b79a-ab37b59a99b5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:11.268590 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d0a53da3-387e-4c77-b79a-ab37b59a99b5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:11.274820 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=46 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:06:11.276986 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0a53da3-387e-4c77-b79a-ab37b59a99b5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:11.277691 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0a53da3-387e-4c77-b79a-ab37b59a99b5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:11.278310 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0a53da3-387e-4c77-b79a-ab37b59a99b5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:11.279208 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0a53da3-387e-4c77-b79a-ab37b59a99b5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:11.279699 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0a53da3-387e-4c77-b79a-ab37b59a99b5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:11.280295 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0a53da3-387e-4c77-b79a-ab37b59a99b5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:11.524482 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d0a53da3-387e-4c77-b79a-ab37b59a99b5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:11.536318 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d0a53da3-387e-4c77-b79a-ab37b59a99b5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1522 microversion: 2.1 time: 0.271358 Aug 26 11:06:11.536318 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 111/209] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:11 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:12.558321 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0acc3586-a2c5-4acb-aade-b0e1fa41fb9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:12.558934 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0acc3586-a2c5-4acb-aade-b0e1fa41fb9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:12.565554 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0acc3586-a2c5-4acb-aade-b0e1fa41fb9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:12.566061 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0acc3586-a2c5-4acb-aade-b0e1fa41fb9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:12.566522 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0acc3586-a2c5-4acb-aade-b0e1fa41fb9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:12.567215 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0acc3586-a2c5-4acb-aade-b0e1fa41fb9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:12.567828 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0acc3586-a2c5-4acb-aade-b0e1fa41fb9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:12.568966 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0acc3586-a2c5-4acb-aade-b0e1fa41fb9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:12.794000 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0acc3586-a2c5-4acb-aade-b0e1fa41fb9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:12.809321 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0acc3586-a2c5-4acb-aade-b0e1fa41fb9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1502 microversion: 2.1 time: 0.254640 Aug 26 11:06:12.824196 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 99/210] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:12 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1502 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:12.831198 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-faa6a476-f083-4848-9eda-8ba09e338bd5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:12.831840 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-faa6a476-f083-4848-9eda-8ba09e338bd5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:12.842719 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-faa6a476-f083-4848-9eda-8ba09e338bd5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:12.844085 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-faa6a476-f083-4848-9eda-8ba09e338bd5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:12.844623 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-faa6a476-f083-4848-9eda-8ba09e338bd5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:12.845596 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-faa6a476-f083-4848-9eda-8ba09e338bd5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:12.846765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-faa6a476-f083-4848-9eda-8ba09e338bd5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:12.847392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-faa6a476-f083-4848-9eda-8ba09e338bd5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:13.138650 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-faa6a476-f083-4848-9eda-8ba09e338bd5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:13.150909 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-faa6a476-f083-4848-9eda-8ba09e338bd5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1516 microversion: 2.1 time: 0.323591 Aug 26 11:06:13.151519 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 112/211] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:12 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1516 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:06:14.759687 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5661af7b-b5e6-4029-a9bf-c908cbe1685b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:06:14.761995 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5661af7b-b5e6-4029-a9bf-c908cbe1685b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:14.769156 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5661af7b-b5e6-4029-a9bf-c908cbe1685b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:14.769781 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5661af7b-b5e6-4029-a9bf-c908cbe1685b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:14.770654 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5661af7b-b5e6-4029-a9bf-c908cbe1685b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:14.772279 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5661af7b-b5e6-4029-a9bf-c908cbe1685b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:14.772908 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5661af7b-b5e6-4029-a9bf-c908cbe1685b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:14.774046 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5661af7b-b5e6-4029-a9bf-c908cbe1685b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:14.801751 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-5661af7b-b5e6-4029-a9bf-c908cbe1685b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lazy-loading 'flavor' on Instance uuid dcc3934b-d598-47c2-9fcb-404b2fe5a478 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:06:14.976346 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5661af7b-b5e6-4029-a9bf-c908cbe1685b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "POST /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478/action" status: 200 len: 32 microversion: 2.1 time: 0.221848 Aug 26 11:06:14.977411 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 100/212] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 11:06:14 2022] POST /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 11:06:14.989519 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2eb6e29d-a724-4c13-81f2-67a7eb283c84 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:14.991408 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2eb6e29d-a724-4c13-81f2-67a7eb283c84 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:15.004266 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2eb6e29d-a724-4c13-81f2-67a7eb283c84 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:15.005539 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2eb6e29d-a724-4c13-81f2-67a7eb283c84 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:15.006092 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2eb6e29d-a724-4c13-81f2-67a7eb283c84 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:15.007419 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2eb6e29d-a724-4c13-81f2-67a7eb283c84 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:15.008049 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2eb6e29d-a724-4c13-81f2-67a7eb283c84 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:15.008630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2eb6e29d-a724-4c13-81f2-67a7eb283c84 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:15.336543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2eb6e29d-a724-4c13-81f2-67a7eb283c84 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:15.346748 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2eb6e29d-a724-4c13-81f2-67a7eb283c84 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.363276 Aug 26 11:06:15.347334 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 113/213] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:14 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:16.369452 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5b601053-4a37-4078-871a-c85f272a9710 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:16.370226 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5b601053-4a37-4078-871a-c85f272a9710 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:16.373549 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:06:16.379516 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5b601053-4a37-4078-871a-c85f272a9710 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:16.381183 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5b601053-4a37-4078-871a-c85f272a9710 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:16.382573 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5b601053-4a37-4078-871a-c85f272a9710 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:16.383453 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5b601053-4a37-4078-871a-c85f272a9710 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:16.383925 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5b601053-4a37-4078-871a-c85f272a9710 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:16.384349 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5b601053-4a37-4078-871a-c85f272a9710 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:16.394396 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:06:16.744675 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5b601053-4a37-4078-871a-c85f272a9710 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:16.766640 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5b601053-4a37-4078-871a-c85f272a9710 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.399904 Aug 26 11:06:16.771470 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 101/214] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:16 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:17.799825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-39c3b4c9-40fa-4586-aee0-353b27535bd8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:17.801128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-39c3b4c9-40fa-4586-aee0-353b27535bd8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:17.808268 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-39c3b4c9-40fa-4586-aee0-353b27535bd8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:17.808999 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-39c3b4c9-40fa-4586-aee0-353b27535bd8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:17.809594 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-39c3b4c9-40fa-4586-aee0-353b27535bd8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:17.810703 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-39c3b4c9-40fa-4586-aee0-353b27535bd8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:17.811390 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-39c3b4c9-40fa-4586-aee0-353b27535bd8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:17.812069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-39c3b4c9-40fa-4586-aee0-353b27535bd8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:18.052509 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-39c3b4c9-40fa-4586-aee0-353b27535bd8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:18.065741 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-39c3b4c9-40fa-4586-aee0-353b27535bd8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.277640 Aug 26 11:06:18.066364 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 114/215] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:17 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:19.087315 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c51f3355-e563-42cb-a8f9-e8f1fe3bbe6e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:19.088647 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c51f3355-e563-42cb-a8f9-e8f1fe3bbe6e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:19.096748 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c51f3355-e563-42cb-a8f9-e8f1fe3bbe6e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:19.097571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c51f3355-e563-42cb-a8f9-e8f1fe3bbe6e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:19.098236 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c51f3355-e563-42cb-a8f9-e8f1fe3bbe6e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:19.099686 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c51f3355-e563-42cb-a8f9-e8f1fe3bbe6e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:19.100337 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c51f3355-e563-42cb-a8f9-e8f1fe3bbe6e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:19.101040 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c51f3355-e563-42cb-a8f9-e8f1fe3bbe6e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:19.263331 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c51f3355-e563-42cb-a8f9-e8f1fe3bbe6e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:19.271680 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c51f3355-e563-42cb-a8f9-e8f1fe3bbe6e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.187779 Aug 26 11:06:19.272353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 102/216] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:19 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:06:20.294337 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-27aa4185-6760-47d3-a58e-1421186636f1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:20.295844 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-27aa4185-6760-47d3-a58e-1421186636f1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:20.305904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-27aa4185-6760-47d3-a58e-1421186636f1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:20.306839 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-27aa4185-6760-47d3-a58e-1421186636f1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:20.307670 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-27aa4185-6760-47d3-a58e-1421186636f1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:20.308418 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-27aa4185-6760-47d3-a58e-1421186636f1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:20.308912 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-27aa4185-6760-47d3-a58e-1421186636f1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:20.309338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-27aa4185-6760-47d3-a58e-1421186636f1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:20.488260 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-27aa4185-6760-47d3-a58e-1421186636f1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:20.497723 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-27aa4185-6760-47d3-a58e-1421186636f1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.208799 Aug 26 11:06:20.498346 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 115/217] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:20 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:21.521852 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f55a9ff7-60b7-4d99-a483-23c0ba0ae46e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:21.523940 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f55a9ff7-60b7-4d99-a483-23c0ba0ae46e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:21.537509 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f55a9ff7-60b7-4d99-a483-23c0ba0ae46e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:21.538364 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f55a9ff7-60b7-4d99-a483-23c0ba0ae46e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:21.540237 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f55a9ff7-60b7-4d99-a483-23c0ba0ae46e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:21.542231 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f55a9ff7-60b7-4d99-a483-23c0ba0ae46e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:21.542963 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f55a9ff7-60b7-4d99-a483-23c0ba0ae46e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:21.543628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f55a9ff7-60b7-4d99-a483-23c0ba0ae46e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:21.774154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f55a9ff7-60b7-4d99-a483-23c0ba0ae46e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:21.782298 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f55a9ff7-60b7-4d99-a483-23c0ba0ae46e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.266773 Aug 26 11:06:21.783110 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 103/218] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:21 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:22.806277 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f3af3d8f-1bca-4421-965a-2eb5c48a9940 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:22.806980 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f3af3d8f-1bca-4421-965a-2eb5c48a9940 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:22.813215 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f3af3d8f-1bca-4421-965a-2eb5c48a9940 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:22.813739 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f3af3d8f-1bca-4421-965a-2eb5c48a9940 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:22.814245 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f3af3d8f-1bca-4421-965a-2eb5c48a9940 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:22.814888 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f3af3d8f-1bca-4421-965a-2eb5c48a9940 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:22.815544 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f3af3d8f-1bca-4421-965a-2eb5c48a9940 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:22.815743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f3af3d8f-1bca-4421-965a-2eb5c48a9940 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:22.982588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f3af3d8f-1bca-4421-965a-2eb5c48a9940 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:22.993613 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f3af3d8f-1bca-4421-965a-2eb5c48a9940 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.192953 Aug 26 11:06:22.994431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 116/219] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:22 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:24.015808 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-8e2a52dc-c862-47a1-bb3b-013a60d1031a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:24.017101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-8e2a52dc-c862-47a1-bb3b-013a60d1031a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:24.025753 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8e2a52dc-c862-47a1-bb3b-013a60d1031a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:24.027148 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8e2a52dc-c862-47a1-bb3b-013a60d1031a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:24.028209 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8e2a52dc-c862-47a1-bb3b-013a60d1031a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:24.029643 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8e2a52dc-c862-47a1-bb3b-013a60d1031a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:24.030338 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8e2a52dc-c862-47a1-bb3b-013a60d1031a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:24.030857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8e2a52dc-c862-47a1-bb3b-013a60d1031a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:24.180508 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8e2a52dc-c862-47a1-bb3b-013a60d1031a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:24.188899 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-8e2a52dc-c862-47a1-bb3b-013a60d1031a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.177064 Aug 26 11:06:24.189673 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 104/220] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:24 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:25.219508 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4e20121a-ded3-46f4-9b8d-30c514a52e28 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:25.220081 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4e20121a-ded3-46f4-9b8d-30c514a52e28 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:25.230005 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e20121a-ded3-46f4-9b8d-30c514a52e28 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:25.230657 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e20121a-ded3-46f4-9b8d-30c514a52e28 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:25.231956 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e20121a-ded3-46f4-9b8d-30c514a52e28 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:25.233237 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e20121a-ded3-46f4-9b8d-30c514a52e28 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:25.233816 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e20121a-ded3-46f4-9b8d-30c514a52e28 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:25.234381 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e20121a-ded3-46f4-9b8d-30c514a52e28 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:25.452573 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4e20121a-ded3-46f4-9b8d-30c514a52e28 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:25.467592 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4e20121a-ded3-46f4-9b8d-30c514a52e28 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.258573 Aug 26 11:06:25.471159 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 117/221] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:25 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:26.492843 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-20c25465-202b-4a1e-8f99-578ed344f61b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:26.493489 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-20c25465-202b-4a1e-8f99-578ed344f61b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:26.501920 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-20c25465-202b-4a1e-8f99-578ed344f61b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:26.502480 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-20c25465-202b-4a1e-8f99-578ed344f61b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:26.502914 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-20c25465-202b-4a1e-8f99-578ed344f61b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:26.503654 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-20c25465-202b-4a1e-8f99-578ed344f61b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:26.504986 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-20c25465-202b-4a1e-8f99-578ed344f61b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:26.510637 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-20c25465-202b-4a1e-8f99-578ed344f61b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:26.663055 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-20c25465-202b-4a1e-8f99-578ed344f61b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:26.671682 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-20c25465-202b-4a1e-8f99-578ed344f61b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.183801 Aug 26 11:06:26.672266 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 105/222] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:26 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:27.692697 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-313c7436-1519-4025-85ac-b44c24a44ff1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:27.693342 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-313c7436-1519-4025-85ac-b44c24a44ff1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:27.700114 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-313c7436-1519-4025-85ac-b44c24a44ff1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:27.700780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-313c7436-1519-4025-85ac-b44c24a44ff1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:27.701388 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-313c7436-1519-4025-85ac-b44c24a44ff1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:27.702595 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-313c7436-1519-4025-85ac-b44c24a44ff1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:27.703350 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-313c7436-1519-4025-85ac-b44c24a44ff1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:27.703926 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-313c7436-1519-4025-85ac-b44c24a44ff1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:27.866078 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-313c7436-1519-4025-85ac-b44c24a44ff1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:27.880051 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-313c7436-1519-4025-85ac-b44c24a44ff1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.189865 Aug 26 11:06:27.880731 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 118/223] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:27 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:28.901554 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-e63b24cc-b14b-4230-bba7-cc42c28a463d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:28.902271 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e63b24cc-b14b-4230-bba7-cc42c28a463d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:28.908830 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e63b24cc-b14b-4230-bba7-cc42c28a463d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:28.909530 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e63b24cc-b14b-4230-bba7-cc42c28a463d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:28.910127 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e63b24cc-b14b-4230-bba7-cc42c28a463d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:28.911002 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e63b24cc-b14b-4230-bba7-cc42c28a463d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:28.912501 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e63b24cc-b14b-4230-bba7-cc42c28a463d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:28.912946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e63b24cc-b14b-4230-bba7-cc42c28a463d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:29.080239 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-e63b24cc-b14b-4230-bba7-cc42c28a463d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:29.088961 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-e63b24cc-b14b-4230-bba7-cc42c28a463d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.191432 Aug 26 11:06:29.089753 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 106/224] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:28 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:30.113334 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f77eeca0-10a3-4169-a424-b2a59c67e0f4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:30.115213 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f77eeca0-10a3-4169-a424-b2a59c67e0f4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:30.127660 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f77eeca0-10a3-4169-a424-b2a59c67e0f4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:30.128430 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f77eeca0-10a3-4169-a424-b2a59c67e0f4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:30.129240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f77eeca0-10a3-4169-a424-b2a59c67e0f4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:30.137235 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f77eeca0-10a3-4169-a424-b2a59c67e0f4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:30.137776 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f77eeca0-10a3-4169-a424-b2a59c67e0f4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:30.138794 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f77eeca0-10a3-4169-a424-b2a59c67e0f4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:30.378899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f77eeca0-10a3-4169-a424-b2a59c67e0f4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:30.391772 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f77eeca0-10a3-4169-a424-b2a59c67e0f4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.282796 Aug 26 11:06:30.393053 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 119/225] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:30 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:31.414637 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1487cc8c-6237-4148-ae98-4a41f74a29b0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:31.415235 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-1487cc8c-6237-4148-ae98-4a41f74a29b0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:31.428759 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1487cc8c-6237-4148-ae98-4a41f74a29b0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:31.429256 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1487cc8c-6237-4148-ae98-4a41f74a29b0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:31.432375 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1487cc8c-6237-4148-ae98-4a41f74a29b0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:31.433275 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1487cc8c-6237-4148-ae98-4a41f74a29b0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:31.433891 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1487cc8c-6237-4148-ae98-4a41f74a29b0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:31.435609 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1487cc8c-6237-4148-ae98-4a41f74a29b0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:31.680330 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1487cc8c-6237-4148-ae98-4a41f74a29b0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:31.695191 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1487cc8c-6237-4148-ae98-4a41f74a29b0 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.286134 Aug 26 11:06:31.709133 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 107/226] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:31 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:32.716855 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8448d438-af18-4e20-a16d-5e0aaaa20c36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:32.726285 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8448d438-af18-4e20-a16d-5e0aaaa20c36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:32.738943 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8448d438-af18-4e20-a16d-5e0aaaa20c36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:32.740147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8448d438-af18-4e20-a16d-5e0aaaa20c36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:32.741024 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8448d438-af18-4e20-a16d-5e0aaaa20c36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:32.742953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8448d438-af18-4e20-a16d-5e0aaaa20c36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:32.743863 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8448d438-af18-4e20-a16d-5e0aaaa20c36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:32.746535 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8448d438-af18-4e20-a16d-5e0aaaa20c36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:33.091970 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8448d438-af18-4e20-a16d-5e0aaaa20c36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:33.110590 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8448d438-af18-4e20-a16d-5e0aaaa20c36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1502 microversion: 2.1 time: 0.396717 Aug 26 11:06:33.112365 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 120/227] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:32 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1502 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:33.135916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-41b77a8f-5873-40fc-ac1a-d51f2c5c6017 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "349507ea-c94a-4912-83ec-92e08fded5a6"}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:06:33.141292 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-41b77a8f-5873-40fc-ac1a-d51f2c5c6017 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:33.150546 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-41b77a8f-5873-40fc-ac1a-d51f2c5c6017 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:33.151396 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-41b77a8f-5873-40fc-ac1a-d51f2c5c6017 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:33.152043 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-41b77a8f-5873-40fc-ac1a-d51f2c5c6017 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:33.152953 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-41b77a8f-5873-40fc-ac1a-d51f2c5c6017 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:33.153650 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-41b77a8f-5873-40fc-ac1a-d51f2c5c6017 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:33.154342 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-41b77a8f-5873-40fc-ac1a-d51f2c5c6017 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:33.209257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-41b77a8f-5873-40fc-ac1a-d51f2c5c6017 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] HTTP exception thrown: Cannot 'attach_volume' instance dcc3934b-d598-47c2-9fcb-404b2fe5a478 while it is in vm_state rescued Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-41b77a8f-5873-40fc-ac1a-d51f2c5c6017 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Request method failure captured: Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: POST /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478/os-volume_attachments HTTP/1.1 Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 74 Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKjKoFWt_mGTxQc01qKCjXUDq7iYUfd7QeRZ0zpT5eoQIJBk_9LMauXMlsoKUf_7HcU9hxiDc2CZHgZUc6PoeUKDo4e4ygyUFdoUFueMawN06Zy51crBpM09ad2MKRCu2-vRhJQ6qXBCPYLTkAj0OO2mr6xCjOndICFG1gqY_Xj_h7k Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: 7db3b983562e49cfbb77c9e64b6e6cb9 Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-818754082 Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:06:33.213393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:06:33.214778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7db3b983562e49cfbb77c9e64b6e6cb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7db3b983562e49cfbb77c9e64b6e6cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7db3b983562e49cfbb77c9e64b6e6cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7db3b983562e49cfbb77c9e64b6e6cb9"}]}] Aug 26 11:06:33.214778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-ServerRescueNegativeTestJSON-818754082 Aug 26 11:06:33.214778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: 7db3b983562e49cfbb77c9e64b6e6cb9 Aug 26 11:06:33.214778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-818754082 Aug 26 11:06:33.214778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-ServerRescueNegativeTestJSON-818754082-project Aug 26 11:06:33.214778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:06:33.214778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:06:33.214778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: d6dbbabdd88c4c088bc91e6c43531318 Aug 26 11:06:33.214778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-ServerRescueNegativeTestJSON-818754082-project Aug 26 11:06:33.214778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Aug 26 11:06:33.214778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {"volumeAttachment": {"volumeId": "349507ea-c94a-4912-83ec-92e08fded5a6"}} Aug 26 11:06:33.214778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Cannot 'attach_volume' instance dcc3934b-d598-47c2-9fcb-404b2fe5a478 while it is in vm_state rescued Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'server_id': 'dcc3934b-d598-47c2-9fcb-404b2fe5a478', 'body': {'volumeAttachment': {'volumeId': '349507ea-c94a-4912-83ec-92e08fded5a6'}}} Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dcc3934b-d598-47c2-9fcb-404b2fe5a478 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:06:33.215494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance dcc3934b-d598-47c2-9fcb-404b2fe5a478 while it is in vm_state rescued Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:06:33.216585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:06:33.217580 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:06:33.217580 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:06:33.217580 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance dcc3934b-d598-47c2-9fcb-404b2fe5a478 while it is in vm_state rescued Aug 26 11:06:33.217580 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:06:33.218280 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-41b77a8f-5873-40fc-ac1a-d51f2c5c6017 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Returning 409 to user: Cannot 'attach_volume' instance dcc3934b-d598-47c2-9fcb-404b2fe5a478 while it is in vm_state rescued {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:06:33.219356 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-41b77a8f-5873-40fc-ac1a-d51f2c5c6017 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "POST /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.089200 Aug 26 11:06:33.220519 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 108/228] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 11:06:33 2022] POST /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478/os-volume_attachments => generated 152 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 26 11:06:33.229511 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-34739048-1e77-46a7-b1eb-e44f8c2c739b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:06:33.230090 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-34739048-1e77-46a7-b1eb-e44f8c2c739b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:33.242011 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-34739048-1e77-46a7-b1eb-e44f8c2c739b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:33.243205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-34739048-1e77-46a7-b1eb-e44f8c2c739b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:33.243752 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-34739048-1e77-46a7-b1eb-e44f8c2c739b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:33.247022 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-34739048-1e77-46a7-b1eb-e44f8c2c739b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:33.247823 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-34739048-1e77-46a7-b1eb-e44f8c2c739b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:33.249084 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-34739048-1e77-46a7-b1eb-e44f8c2c739b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:33.404466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-34739048-1e77-46a7-b1eb-e44f8c2c739b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "POST /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478/action" status: 202 len: 0 microversion: 2.1 time: 0.178717 Aug 26 11:06:33.405723 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 121/229] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 11:06:33 2022] POST /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:06:33.421120 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c42a7af3-df27-4554-9be4-cd3fbcff5900 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:33.422079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c42a7af3-df27-4554-9be4-cd3fbcff5900 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:33.446890 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c42a7af3-df27-4554-9be4-cd3fbcff5900 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:33.463155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c42a7af3-df27-4554-9be4-cd3fbcff5900 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:33.464021 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c42a7af3-df27-4554-9be4-cd3fbcff5900 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:33.465038 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c42a7af3-df27-4554-9be4-cd3fbcff5900 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:33.465869 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c42a7af3-df27-4554-9be4-cd3fbcff5900 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:33.466758 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c42a7af3-df27-4554-9be4-cd3fbcff5900 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:33.927528 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c42a7af3-df27-4554-9be4-cd3fbcff5900 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:33.944379 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c42a7af3-df27-4554-9be4-cd3fbcff5900 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1510 microversion: 2.1 time: 0.531089 Aug 26 11:06:33.946566 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 109/230] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:33 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1510 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:34.970412 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8034e1cf-9a49-4e2f-8f2a-311328266470 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:34.971109 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8034e1cf-9a49-4e2f-8f2a-311328266470 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:34.980079 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8034e1cf-9a49-4e2f-8f2a-311328266470 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:34.980576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8034e1cf-9a49-4e2f-8f2a-311328266470 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:34.981016 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8034e1cf-9a49-4e2f-8f2a-311328266470 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:34.981722 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8034e1cf-9a49-4e2f-8f2a-311328266470 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:34.982271 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8034e1cf-9a49-4e2f-8f2a-311328266470 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:34.982715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8034e1cf-9a49-4e2f-8f2a-311328266470 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:35.156702 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8034e1cf-9a49-4e2f-8f2a-311328266470 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:35.170586 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8034e1cf-9a49-4e2f-8f2a-311328266470 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1510 microversion: 2.1 time: 0.204075 Aug 26 11:06:35.184299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 122/231] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:34 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:36.190627 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0eeaaec8-ea2e-416d-beef-833dabe497c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:36.191241 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0eeaaec8-ea2e-416d-beef-833dabe497c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:36.198880 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0eeaaec8-ea2e-416d-beef-833dabe497c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:36.199369 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0eeaaec8-ea2e-416d-beef-833dabe497c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:36.199802 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0eeaaec8-ea2e-416d-beef-833dabe497c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:36.200497 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0eeaaec8-ea2e-416d-beef-833dabe497c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:36.201210 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0eeaaec8-ea2e-416d-beef-833dabe497c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:36.201635 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0eeaaec8-ea2e-416d-beef-833dabe497c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:36.380315 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0eeaaec8-ea2e-416d-beef-833dabe497c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:36.388294 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0eeaaec8-ea2e-416d-beef-833dabe497c1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1510 microversion: 2.1 time: 0.201545 Aug 26 11:06:36.389196 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 110/232] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:36 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:37.409402 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-07ae3fdc-d388-402a-87ed-ad29a0d4df86 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:37.409913 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-07ae3fdc-d388-402a-87ed-ad29a0d4df86 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:37.417097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-07ae3fdc-d388-402a-87ed-ad29a0d4df86 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:37.417931 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-07ae3fdc-d388-402a-87ed-ad29a0d4df86 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:37.418543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-07ae3fdc-d388-402a-87ed-ad29a0d4df86 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:37.419569 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-07ae3fdc-d388-402a-87ed-ad29a0d4df86 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:37.420169 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-07ae3fdc-d388-402a-87ed-ad29a0d4df86 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:37.420743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-07ae3fdc-d388-402a-87ed-ad29a0d4df86 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:37.423704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:06:37.614912 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-07ae3fdc-d388-402a-87ed-ad29a0d4df86 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:37.638328 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-07ae3fdc-d388-402a-87ed-ad29a0d4df86 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1516 microversion: 2.1 time: 0.232727 Aug 26 11:06:37.654947 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 123/233] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:37 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1516 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:41.245635 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a8b2a5b8-a266-447c-ac18-10dba63be57b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Action: 'create', calling method: .version_select at 0x7f1a68ce01f0>, body: {"keypair": {"name": "tempest-keypair-544214292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEMRtbOlBdTKXQEUT9anujf8u8XMjcql7EwHoECRKvA4NwK2YWJmcFJP7b1Tn6Or3JInLwzr+Bml//DsNaUePoIYAp0Zbh7IcJYEWFazoxbK2ombYJYX/QJRs3do6MsJg=="}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:06:41.264905 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-a8b2a5b8-a266-447c-ac18-10dba63be57b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Getting quotas for project 7db3b983562e49cfbb77c9e64b6e6cb9. Resources: {'key_pairs'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:06:41.271479 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-a8b2a5b8-a266-447c-ac18-10dba63be57b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Getting quotas for user d6dbbabdd88c4c088bc91e6c43531318 and project 7db3b983562e49cfbb77c9e64b6e6cb9. Resources: {'key_pairs'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:06:41.315497 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-a8b2a5b8-a266-447c-ac18-10dba63be57b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.068954 Aug 26 11:06:41.316116 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 111/234] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 11:06:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:06:41.816416 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7d2c0825-c14b-4bb0-bb60-2f084487fa7b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:41.818398 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7d2c0825-c14b-4bb0-bb60-2f084487fa7b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:41.822210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=26 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:06:41.832597 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d2c0825-c14b-4bb0-bb60-2f084487fa7b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:41.835585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d2c0825-c14b-4bb0-bb60-2f084487fa7b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:41.837335 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d2c0825-c14b-4bb0-bb60-2f084487fa7b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:41.841962 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d2c0825-c14b-4bb0-bb60-2f084487fa7b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:41.841962 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d2c0825-c14b-4bb0-bb60-2f084487fa7b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:41.841962 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d2c0825-c14b-4bb0-bb60-2f084487fa7b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:41.928612 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7d2c0825-c14b-4bb0-bb60-2f084487fa7b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/ips" status: 200 len: 153 microversion: 2.20 time: 0.116433 Aug 26 11:06:41.929788 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 124/235] 10.222.0.40 () {60 vars in 1289 bytes} [Fri Aug 26 11:06:41 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/ips => generated 153 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 11:06:43.585129 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-540717251", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60347e96-6659-4e98-860c-bd915107c9fd"}], "security_groups": [{"name": "tempest-securitygroup--480430077"}], "key_name": "tempest-keypair-544214292", "user_data": "}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:06:43.727924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.network.neutron [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] validate_networks() for [('60347e96-6659-4e98-860c-bd915107c9fd', None, None, None, None, None)] {{(pid=120605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:06:44.268610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Flavor limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:06:44.269397 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Image limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:06:44.270034 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Flavor pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:06:44.271308 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Image pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:06:44.272056 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:06:44.283533 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:44.284295 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:44.284897 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:44.285855 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:44.287121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:44.287963 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:44.309006 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Getting quotas for project 7db3b983562e49cfbb77c9e64b6e6cb9. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:06:44.313363 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Getting quotas for user d6dbbabdd88c4c088bc91e6c43531318 and project 7db3b983562e49cfbb77c9e64b6e6cb9. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:06:44.326090 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Going to run 1 instances... {{(pid=120605) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:06:44.328821 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:06:44.382748 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c408f781-7a92-4373-8961-ee9d0c891ddf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.809227 Aug 26 11:06:44.384107 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 112/236] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:06:43 2022] POST /compute/v2.1/servers => generated 408 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:06:44.396023 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0f230a37-72d1-42bf-a11e-d43c430fb458 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:44.396669 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0f230a37-72d1-42bf-a11e-d43c430fb458 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:44.480233 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0f230a37-72d1-42bf-a11e-d43c430fb458 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:44.488295 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0f230a37-72d1-42bf-a11e-d43c430fb458 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1244 microversion: 2.1 time: 0.097184 Aug 26 11:06:44.504394 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 125/237] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:44 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1244 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:44.823544 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a56fd04a-98d2-4a02-9262-4863feb43a1e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:06:44.824152 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-a56fd04a-98d2-4a02-9262-4863feb43a1e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:44.835020 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a56fd04a-98d2-4a02-9262-4863feb43a1e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:44.835783 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a56fd04a-98d2-4a02-9262-4863feb43a1e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:44.836427 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a56fd04a-98d2-4a02-9262-4863feb43a1e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:44.837486 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a56fd04a-98d2-4a02-9262-4863feb43a1e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:44.838254 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a56fd04a-98d2-4a02-9262-4863feb43a1e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:44.838930 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a56fd04a-98d2-4a02-9262-4863feb43a1e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:44.892973 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-a56fd04a-98d2-4a02-9262-4863feb43a1e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lazy-loading 'flavor' on Instance uuid 01ae91d9-0521-4d14-b2b6-e56f249c4181 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:06:45.177481 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-a56fd04a-98d2-4a02-9262-4863feb43a1e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "POST /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/action" status: 202 len: 0 microversion: 2.20 time: 0.359749 Aug 26 11:06:45.180803 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 113/238] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Aug 26 11:06:44 2022] POST /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:06:45.189364 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-179056a3-5ef2-4e76-a52d-f91a9fe4bc98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:45.190662 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-179056a3-5ef2-4e76-a52d-f91a9fe4bc98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:45.196801 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-179056a3-5ef2-4e76-a52d-f91a9fe4bc98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:45.197591 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-179056a3-5ef2-4e76-a52d-f91a9fe4bc98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:45.198271 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-179056a3-5ef2-4e76-a52d-f91a9fe4bc98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:45.199205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-179056a3-5ef2-4e76-a52d-f91a9fe4bc98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:45.200047 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-179056a3-5ef2-4e76-a52d-f91a9fe4bc98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:45.201302 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-179056a3-5ef2-4e76-a52d-f91a9fe4bc98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:45.455931 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-179056a3-5ef2-4e76-a52d-f91a9fe4bc98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:45.488863 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-179056a3-5ef2-4e76-a52d-f91a9fe4bc98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:45.494195 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-179056a3-5ef2-4e76-a52d-f91a9fe4bc98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:45.498326 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-179056a3-5ef2-4e76-a52d-f91a9fe4bc98 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.311417 Aug 26 11:06:45.502601 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 126/239] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:06:45 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:06:45.515721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0f8f6b1d-db15-4954-bbae-2d09b1649914 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:45.516509 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0f8f6b1d-db15-4954-bbae-2d09b1649914 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:45.525944 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f8f6b1d-db15-4954-bbae-2d09b1649914 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:45.527082 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f8f6b1d-db15-4954-bbae-2d09b1649914 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:45.527707 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f8f6b1d-db15-4954-bbae-2d09b1649914 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:45.528642 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f8f6b1d-db15-4954-bbae-2d09b1649914 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:45.529394 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f8f6b1d-db15-4954-bbae-2d09b1649914 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:45.529819 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f8f6b1d-db15-4954-bbae-2d09b1649914 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:45.639316 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0f8f6b1d-db15-4954-bbae-2d09b1649914 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:45.648594 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0f8f6b1d-db15-4954-bbae-2d09b1649914 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1296 microversion: 2.1 time: 0.140732 Aug 26 11:06:45.649667 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 114/240] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:45 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1296 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:46.527815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b65818bc-9622-4880-9423-85aa9e66d990 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:46.528605 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b65818bc-9622-4880-9423-85aa9e66d990 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:46.541787 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b65818bc-9622-4880-9423-85aa9e66d990 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:46.544557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b65818bc-9622-4880-9423-85aa9e66d990 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:46.546799 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b65818bc-9622-4880-9423-85aa9e66d990 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:46.547989 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b65818bc-9622-4880-9423-85aa9e66d990 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:46.549324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b65818bc-9622-4880-9423-85aa9e66d990 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:46.550758 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b65818bc-9622-4880-9423-85aa9e66d990 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:46.676017 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-8b49d347-28cb-4dd1-888f-bef3043e9729 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:46.682179 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-8b49d347-28cb-4dd1-888f-bef3043e9729 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:46.697637 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:06:46.703983 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8b49d347-28cb-4dd1-888f-bef3043e9729 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:46.704902 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8b49d347-28cb-4dd1-888f-bef3043e9729 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:46.707285 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8b49d347-28cb-4dd1-888f-bef3043e9729 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:46.708552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8b49d347-28cb-4dd1-888f-bef3043e9729 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:46.709443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8b49d347-28cb-4dd1-888f-bef3043e9729 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:46.715883 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8b49d347-28cb-4dd1-888f-bef3043e9729 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:46.994834 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b65818bc-9622-4880-9423-85aa9e66d990 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:47.010488 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b65818bc-9622-4880-9423-85aa9e66d990 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:47.011943 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b65818bc-9622-4880-9423-85aa9e66d990 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:47.025487 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:06:47.030629 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b65818bc-9622-4880-9423-85aa9e66d990 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.508265 Aug 26 11:06:47.032262 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 127/241] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:06:46 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:06:47.163361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8b49d347-28cb-4dd1-888f-bef3043e9729 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:47.176560 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-8b49d347-28cb-4dd1-888f-bef3043e9729 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1302 microversion: 2.1 time: 0.506385 Aug 26 11:06:47.179368 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 115/242] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:46 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1302 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:48.057968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-51341308-9f60-48e9-9c02-4350d1ff98c9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:48.059366 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-51341308-9f60-48e9-9c02-4350d1ff98c9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:48.078092 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-51341308-9f60-48e9-9c02-4350d1ff98c9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:48.078591 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-51341308-9f60-48e9-9c02-4350d1ff98c9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:48.079063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-51341308-9f60-48e9-9c02-4350d1ff98c9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:48.081876 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-51341308-9f60-48e9-9c02-4350d1ff98c9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:48.082763 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-51341308-9f60-48e9-9c02-4350d1ff98c9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:48.083940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-51341308-9f60-48e9-9c02-4350d1ff98c9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:48.210665 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f4cb362a-9e14-444a-9514-135f1551f056 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:48.213808 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f4cb362a-9e14-444a-9514-135f1551f056 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:48.227360 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4cb362a-9e14-444a-9514-135f1551f056 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:48.232255 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4cb362a-9e14-444a-9514-135f1551f056 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:48.233245 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4cb362a-9e14-444a-9514-135f1551f056 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:48.234334 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4cb362a-9e14-444a-9514-135f1551f056 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:48.250798 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4cb362a-9e14-444a-9514-135f1551f056 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:48.254299 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4cb362a-9e14-444a-9514-135f1551f056 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:48.379607 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-51341308-9f60-48e9-9c02-4350d1ff98c9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:48.391909 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-51341308-9f60-48e9-9c02-4350d1ff98c9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:48.397745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-51341308-9f60-48e9-9c02-4350d1ff98c9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:48.399090 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-51341308-9f60-48e9-9c02-4350d1ff98c9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.345944 Aug 26 11:06:48.403317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 128/243] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:06:48 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:06:48.616491 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f4cb362a-9e14-444a-9514-135f1551f056 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:48.635448 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f4cb362a-9e14-444a-9514-135f1551f056 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1369 microversion: 2.1 time: 0.435113 Aug 26 11:06:48.636227 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 116/244] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:48 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1369 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:06:48.671419 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-24fec981-52cd-46c6-b350-e2ac4471828d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Action: 'create', calling method: .version_select at 0x7f1a68bb7f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-54957731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUjQdPBwx1ILyuaAzkSQL4bTiNnU6kibasY8yYbaZVWjmSNQm9OxmHWBxg5tSLpzAAVEDJmAiyMVM4y5bhfZvq8yZEtYTHcBu0LcRKeD0t+R4zPvcZcFz2tQ1/0CY7jxQ=="}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:06:48.702999 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-24fec981-52cd-46c6-b350-e2ac4471828d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Getting quotas for project 9483fc8d1764471b99c49e4ee46c0b12. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:06:48.707126 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-24fec981-52cd-46c6-b350-e2ac4471828d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Getting quotas for user be8fb67568674d0b91424e2a16407539 and project 9483fc8d1764471b99c49e4ee46c0b12. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:06:48.737437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-24fec981-52cd-46c6-b350-e2ac4471828d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.070059 Aug 26 11:06:48.740965 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 129/245] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 11:06:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:06:48.848324 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-34e9d1da-2b9f-429f-ac63-641a0552e985 req-e1cec6f2-c70a-4579-a8d7-2941499d54ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9530d01a-c2a4-44f2-a631-31faa3921205", "tag": "4641460f-7920-49e5-b889-55969872b7b8"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:06:48.866484 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-34e9d1da-2b9f-429f-ac63-641a0552e985 req-e1cec6f2-c70a-4579-a8d7-2941499d54ea service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:48.867249 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-34e9d1da-2b9f-429f-ac63-641a0552e985 req-e1cec6f2-c70a-4579-a8d7-2941499d54ea service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:48.868196 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-34e9d1da-2b9f-429f-ac63-641a0552e985 req-e1cec6f2-c70a-4579-a8d7-2941499d54ea service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:48.883743 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-34e9d1da-2b9f-429f-ac63-641a0552e985 req-e1cec6f2-c70a-4579-a8d7-2941499d54ea service nova] Creating event network-changed:4641460f-7920-49e5-b889-55969872b7b8 for instance 9530d01a-c2a4-44f2-a631-31faa3921205 on hv-cinder-85236 Aug 26 11:06:48.889039 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-34e9d1da-2b9f-429f-ac63-641a0552e985 req-e1cec6f2-c70a-4579-a8d7-2941499d54ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045215 Aug 26 11:06:48.890502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 117/246] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:06:48.915371 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-990031996", "imageRef": "0e5e764f-a071-4f4f-a41d-dd75a7cfc0af", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-54957731", "networks": [{"uuid": "426ac268-6352-4ff6-8ccf-3e1553d8ca07"}]}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:06:48.997427 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] validate_networks() for [('426ac268-6352-4ff6-8ccf-3e1553d8ca07', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:06:49.429219 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0d6b9767-98df-4f69-a266-b6be93cc4bb0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:49.431559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0d6b9767-98df-4f69-a266-b6be93cc4bb0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:49.446661 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0d6b9767-98df-4f69-a266-b6be93cc4bb0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:49.448137 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0d6b9767-98df-4f69-a266-b6be93cc4bb0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:49.448684 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0d6b9767-98df-4f69-a266-b6be93cc4bb0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:49.449608 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0d6b9767-98df-4f69-a266-b6be93cc4bb0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:49.450449 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0d6b9767-98df-4f69-a266-b6be93cc4bb0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:49.451154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0d6b9767-98df-4f69-a266-b6be93cc4bb0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:49.997526 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0d6b9767-98df-4f69-a266-b6be93cc4bb0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:50.017108 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0d6b9767-98df-4f69-a266-b6be93cc4bb0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:50.022381 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0d6b9767-98df-4f69-a266-b6be93cc4bb0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:50.025029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0d6b9767-98df-4f69-a266-b6be93cc4bb0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.604595 Aug 26 11:06:50.026989 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 118/247] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:06:49 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:06:50.044664 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-cdfd9dbb-c938-473c-889f-581f721e26ef tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:50.045761 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-cdfd9dbb-c938-473c-889f-581f721e26ef tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:50.047295 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:06:50.047772 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:06:50.048190 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:06:50.048623 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:06:50.049013 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:06:50.053848 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cdfd9dbb-c938-473c-889f-581f721e26ef tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:50.054388 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cdfd9dbb-c938-473c-889f-581f721e26ef tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:50.054822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cdfd9dbb-c938-473c-889f-581f721e26ef tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:50.055525 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cdfd9dbb-c938-473c-889f-581f721e26ef tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:50.056105 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cdfd9dbb-c938-473c-889f-581f721e26ef tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:50.056530 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cdfd9dbb-c938-473c-889f-581f721e26ef tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:50.060215 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:50.061045 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:50.061947 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:50.063391 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:50.064202 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:50.065309 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:50.094431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Getting quotas for project 9483fc8d1764471b99c49e4ee46c0b12. Resources: {'instances', 'ram', 'cores'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:06:50.099134 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Getting quotas for user be8fb67568674d0b91424e2a16407539 and project 9483fc8d1764471b99c49e4ee46c0b12. Resources: {'instances', 'ram', 'cores'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:06:50.120409 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:06:50.123025 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0e5e764f-a071-4f4f-a41d-dd75a7cfc0af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:06:50.182943 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3f8f3ff1-cce6-4c53-ac0c-790fcfeb5651 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.269114 Aug 26 11:06:50.182943 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 130/248] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:06:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:06:50.194363 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d300d0e5-f077-44b0-a713-38cdf4f97b6f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:50.195270 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d300d0e5-f077-44b0-a713-38cdf4f97b6f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:50.228381 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-cdfd9dbb-c938-473c-889f-581f721e26ef tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:50.236638 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-cdfd9dbb-c938-473c-889f-581f721e26ef tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1369 microversion: 2.1 time: 0.207571 Aug 26 11:06:50.237894 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 119/249] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:50 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1369 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:50.266676 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d300d0e5-f077-44b0-a713-38cdf4f97b6f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:50.275169 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d300d0e5-f077-44b0-a713-38cdf4f97b6f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1256 microversion: 2.1 time: 0.085884 Aug 26 11:06:50.275732 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 131/250] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:50 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1256 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:51.053721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4e9b96f9-96ff-4974-9a0d-3b36d7438a63 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:51.054794 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4e9b96f9-96ff-4974-9a0d-3b36d7438a63 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:51.078269 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e9b96f9-96ff-4974-9a0d-3b36d7438a63 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:51.079069 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e9b96f9-96ff-4974-9a0d-3b36d7438a63 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:51.079792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e9b96f9-96ff-4974-9a0d-3b36d7438a63 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:51.085878 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e9b96f9-96ff-4974-9a0d-3b36d7438a63 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:51.090031 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e9b96f9-96ff-4974-9a0d-3b36d7438a63 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:51.091001 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e9b96f9-96ff-4974-9a0d-3b36d7438a63 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:51.262212 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a73e0579-ccc3-4a73-8f76-87953b3a56d1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:51.264334 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a73e0579-ccc3-4a73-8f76-87953b3a56d1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:51.282973 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a73e0579-ccc3-4a73-8f76-87953b3a56d1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:51.290797 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a73e0579-ccc3-4a73-8f76-87953b3a56d1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:51.291781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a73e0579-ccc3-4a73-8f76-87953b3a56d1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:51.295857 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a73e0579-ccc3-4a73-8f76-87953b3a56d1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:51.297749 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a73e0579-ccc3-4a73-8f76-87953b3a56d1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:51.300456 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a73e0579-ccc3-4a73-8f76-87953b3a56d1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:51.402044 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4e9b96f9-96ff-4974-9a0d-3b36d7438a63 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:51.417100 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4e9b96f9-96ff-4974-9a0d-3b36d7438a63 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:51.418830 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4e9b96f9-96ff-4974-9a0d-3b36d7438a63 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:51.420061 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4e9b96f9-96ff-4974-9a0d-3b36d7438a63 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.374164 Aug 26 11:06:51.423112 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 120/251] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:06:51 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:06:51.428410 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a20eccc5-8174-42bb-a052-3490269d1444 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:51.429111 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-a20eccc5-8174-42bb-a052-3490269d1444 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:51.443584 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a20eccc5-8174-42bb-a052-3490269d1444 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:51.444571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a20eccc5-8174-42bb-a052-3490269d1444 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:51.446228 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a20eccc5-8174-42bb-a052-3490269d1444 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:51.448517 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a20eccc5-8174-42bb-a052-3490269d1444 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:51.450654 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a20eccc5-8174-42bb-a052-3490269d1444 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:51.452730 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a20eccc5-8174-42bb-a052-3490269d1444 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:51.596588 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-a20eccc5-8174-42bb-a052-3490269d1444 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:51.607437 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-a20eccc5-8174-42bb-a052-3490269d1444 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1308 microversion: 2.1 time: 0.185141 Aug 26 11:06:51.620224 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 121/252] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:51 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1308 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:51.620224 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2016130220", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452"}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:06:51.694470 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.network.neutron [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] validate_networks() for None {{(pid=120605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:06:51.728459 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a73e0579-ccc3-4a73-8f76-87953b3a56d1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:51.751653 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a73e0579-ccc3-4a73-8f76-87953b3a56d1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1369 microversion: 2.1 time: 0.496119 Aug 26 11:06:51.755986 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 132/253] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:51 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1369 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:52.127442 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Flavor limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:06:52.128381 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Image limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:06:52.129014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Flavor pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:06:52.129511 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Image pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:06:52.130429 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:06:52.140736 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:52.141496 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:52.142167 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:52.143117 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:52.144690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:52.145342 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:52.168120 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Getting quotas for project 1b87c51628c342cfa953a7110735d469. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:06:52.173941 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Getting quotas for user 275df87a6e384102be2194b74b180358 and project 1b87c51628c342cfa953a7110735d469. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:06:52.188842 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Going to run 1 instances... {{(pid=120605) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:06:52.191866 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:06:52.251649 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-355885f4-213c-4f8f-b284-214dd47f0954 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642044 Aug 26 11:06:52.252521 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 122/254] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:06:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:06:52.256418 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-28b64755-9462-4481-89c3-b2cfd87f07ed tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:52.256922 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-28b64755-9462-4481-89c3-b2cfd87f07ed tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:52.264036 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-20069650-bb39-4b84-880c-5162d2e8852e tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:52.264734 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-20069650-bb39-4b84-880c-5162d2e8852e tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:52.278277 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28b64755-9462-4481-89c3-b2cfd87f07ed tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:52.279202 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28b64755-9462-4481-89c3-b2cfd87f07ed tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:52.279879 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28b64755-9462-4481-89c3-b2cfd87f07ed tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:52.281011 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28b64755-9462-4481-89c3-b2cfd87f07ed tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:52.281740 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28b64755-9462-4481-89c3-b2cfd87f07ed tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:52.282706 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28b64755-9462-4481-89c3-b2cfd87f07ed tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:52.328541 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-28b64755-9462-4481-89c3-b2cfd87f07ed tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/ips" status: 200 len: 145 microversion: 2.1 time: 0.076670 Aug 26 11:06:52.329562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 133/255] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 11:06:52 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/ips => generated 145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:06:52.372636 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-20069650-bb39-4b84-880c-5162d2e8852e tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:52.382541 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-20069650-bb39-4b84-880c-5162d2e8852e tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1215 microversion: 2.1 time: 0.122217 Aug 26 11:06:52.393579 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 123/256] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:52 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1215 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:06:52.462946 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-01aa1a1c-39df-4e73-ae50-4114fc5de777 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:52.463804 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-01aa1a1c-39df-4e73-ae50-4114fc5de777 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:52.481097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-01aa1a1c-39df-4e73-ae50-4114fc5de777 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:52.482139 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-01aa1a1c-39df-4e73-ae50-4114fc5de777 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:52.482786 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-01aa1a1c-39df-4e73-ae50-4114fc5de777 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:52.484096 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-01aa1a1c-39df-4e73-ae50-4114fc5de777 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:52.484731 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-01aa1a1c-39df-4e73-ae50-4114fc5de777 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:52.485314 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-01aa1a1c-39df-4e73-ae50-4114fc5de777 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:52.639716 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0071ca3d-65a6-43cf-9452-3e12e978526c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:52.640534 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0071ca3d-65a6-43cf-9452-3e12e978526c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:52.649455 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-01aa1a1c-39df-4e73-ae50-4114fc5de777 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:52.653630 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0071ca3d-65a6-43cf-9452-3e12e978526c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:52.655409 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0071ca3d-65a6-43cf-9452-3e12e978526c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:52.663819 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-01aa1a1c-39df-4e73-ae50-4114fc5de777 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:52.664781 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0071ca3d-65a6-43cf-9452-3e12e978526c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:52.667453 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-01aa1a1c-39df-4e73-ae50-4114fc5de777 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:52.670225 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-01aa1a1c-39df-4e73-ae50-4114fc5de777 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.212838 Aug 26 11:06:52.671188 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0071ca3d-65a6-43cf-9452-3e12e978526c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:52.671868 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0071ca3d-65a6-43cf-9452-3e12e978526c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:52.673274 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0071ca3d-65a6-43cf-9452-3e12e978526c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:52.682745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 134/257] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:06:52 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:06:52.751760 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0071ca3d-65a6-43cf-9452-3e12e978526c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:52.761485 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0071ca3d-65a6-43cf-9452-3e12e978526c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1314 microversion: 2.1 time: 0.127218 Aug 26 11:06:52.762681 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 124/258] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:52 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1314 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:52.775844 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2adf1173-8ddf-404b-a78d-a57b59af4bd6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:52.776573 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2adf1173-8ddf-404b-a78d-a57b59af4bd6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:52.797404 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2adf1173-8ddf-404b-a78d-a57b59af4bd6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:52.798318 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2adf1173-8ddf-404b-a78d-a57b59af4bd6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:52.801761 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2adf1173-8ddf-404b-a78d-a57b59af4bd6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:52.805628 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2adf1173-8ddf-404b-a78d-a57b59af4bd6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:52.806162 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2adf1173-8ddf-404b-a78d-a57b59af4bd6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:52.806592 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2adf1173-8ddf-404b-a78d-a57b59af4bd6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:53.128436 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2adf1173-8ddf-404b-a78d-a57b59af4bd6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:53.142979 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2adf1173-8ddf-404b-a78d-a57b59af4bd6 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1369 microversion: 2.1 time: 0.370334 Aug 26 11:06:53.153855 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 135/259] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:52 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1369 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:53.408566 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4d24dc3a-14d6-4c52-85e3-0c071187cd3e tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:53.411875 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4d24dc3a-14d6-4c52-85e3-0c071187cd3e tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:53.438821 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4d24dc3a-14d6-4c52-85e3-0c071187cd3e tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:53.439679 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4d24dc3a-14d6-4c52-85e3-0c071187cd3e tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:53.443773 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4d24dc3a-14d6-4c52-85e3-0c071187cd3e tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:53.447548 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4d24dc3a-14d6-4c52-85e3-0c071187cd3e tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:53.451987 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4d24dc3a-14d6-4c52-85e3-0c071187cd3e tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:53.454708 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4d24dc3a-14d6-4c52-85e3-0c071187cd3e tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:53.691279 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4d24dc3a-14d6-4c52-85e3-0c071187cd3e tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:53.701918 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2cc6e34a-d84e-4b84-9b6b-3c78d5491db6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:53.702503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2cc6e34a-d84e-4b84-9b6b-3c78d5491db6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:53.722263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4d24dc3a-14d6-4c52-85e3-0c071187cd3e tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1211 microversion: 2.1 time: 0.320257 Aug 26 11:06:53.739895 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 125/260] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:53 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1211 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:53.750125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2cc6e34a-d84e-4b84-9b6b-3c78d5491db6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:53.750125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2cc6e34a-d84e-4b84-9b6b-3c78d5491db6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:53.751516 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2cc6e34a-d84e-4b84-9b6b-3c78d5491db6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:53.756264 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2cc6e34a-d84e-4b84-9b6b-3c78d5491db6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:53.756998 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2cc6e34a-d84e-4b84-9b6b-3c78d5491db6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:53.759534 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2cc6e34a-d84e-4b84-9b6b-3c78d5491db6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:53.784838 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-11f117e5-0b56-4cbf-848a-46e270adc352 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:53.785775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-11f117e5-0b56-4cbf-848a-46e270adc352 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:53.808751 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-11f117e5-0b56-4cbf-848a-46e270adc352 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:53.827224 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-11f117e5-0b56-4cbf-848a-46e270adc352 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:53.828194 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-11f117e5-0b56-4cbf-848a-46e270adc352 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:53.829257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-11f117e5-0b56-4cbf-848a-46e270adc352 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:53.835928 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-11f117e5-0b56-4cbf-848a-46e270adc352 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:53.836748 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-11f117e5-0b56-4cbf-848a-46e270adc352 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:54.477964 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-11f117e5-0b56-4cbf-848a-46e270adc352 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:54.503846 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-11f117e5-0b56-4cbf-848a-46e270adc352 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1356 microversion: 2.1 time: 0.722656 Aug 26 11:06:54.507888 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 126/261] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:53 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1356 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:06:54.533612 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-82f32544-33dc-406f-b39e-3937d1bd3cec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:54.537723 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-82f32544-33dc-406f-b39e-3937d1bd3cec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:54.546193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-82f32544-33dc-406f-b39e-3937d1bd3cec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:54.546996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-82f32544-33dc-406f-b39e-3937d1bd3cec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:54.547661 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-82f32544-33dc-406f-b39e-3937d1bd3cec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:54.548952 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-82f32544-33dc-406f-b39e-3937d1bd3cec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:54.549743 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-82f32544-33dc-406f-b39e-3937d1bd3cec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:54.550547 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-82f32544-33dc-406f-b39e-3937d1bd3cec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:54.554876 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2cc6e34a-d84e-4b84-9b6b-3c78d5491db6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:54.598304 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2cc6e34a-d84e-4b84-9b6b-3c78d5491db6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:54.609509 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2cc6e34a-d84e-4b84-9b6b-3c78d5491db6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:54.619463 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2cc6e34a-d84e-4b84-9b6b-3c78d5491db6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.926916 Aug 26 11:06:54.622764 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 136/262] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:06:53 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:06:54.631628 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-3bcf67fc-88ba-4243-86d4-a5a2904d5d2a req-f329801c-159a-4273-b1cb-b52315ccf8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136f48c9-a521-4bc3-b6cc-98da91d02c49", "tag": "9431c858-ac93-4f2b-a673-fd8e539b68c8"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:06:54.660872 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-3bcf67fc-88ba-4243-86d4-a5a2904d5d2a req-f329801c-159a-4273-b1cb-b52315ccf8d4 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:54.662865 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-3bcf67fc-88ba-4243-86d4-a5a2904d5d2a req-f329801c-159a-4273-b1cb-b52315ccf8d4 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:54.667187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-3bcf67fc-88ba-4243-86d4-a5a2904d5d2a req-f329801c-159a-4273-b1cb-b52315ccf8d4 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:54.687903 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-3bcf67fc-88ba-4243-86d4-a5a2904d5d2a req-f329801c-159a-4273-b1cb-b52315ccf8d4 service nova] Creating event network-changed:9431c858-ac93-4f2b-a673-fd8e539b68c8 for instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 on hv-cinder-85236 Aug 26 11:06:54.709312 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-3bcf67fc-88ba-4243-86d4-a5a2904d5d2a req-f329801c-159a-4273-b1cb-b52315ccf8d4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078649 Aug 26 11:06:54.710107 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 137/263] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:06:54.758579 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-480a2b23-2a80-4d75-bcde-c382290dcfbb tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:54.759549 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-480a2b23-2a80-4d75-bcde-c382290dcfbb tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:54.775999 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-480a2b23-2a80-4d75-bcde-c382290dcfbb tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:54.777698 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-480a2b23-2a80-4d75-bcde-c382290dcfbb tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:54.783478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-480a2b23-2a80-4d75-bcde-c382290dcfbb tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:54.785122 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-480a2b23-2a80-4d75-bcde-c382290dcfbb tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:54.785612 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-480a2b23-2a80-4d75-bcde-c382290dcfbb tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:54.786770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-480a2b23-2a80-4d75-bcde-c382290dcfbb tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:54.838885 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-82f32544-33dc-406f-b39e-3937d1bd3cec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:54.849917 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-82f32544-33dc-406f-b39e-3937d1bd3cec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1369 microversion: 2.1 time: 0.338209 Aug 26 11:06:54.850470 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 127/264] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:54 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1369 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:54.930791 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-480a2b23-2a80-4d75-bcde-c382290dcfbb tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:54.941517 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-480a2b23-2a80-4d75-bcde-c382290dcfbb tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1267 microversion: 2.1 time: 0.187858 Aug 26 11:06:54.955652 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 138/265] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:54 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:54.976016 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-3479e22c-8b17-4f3d-a18d-388f52348e0f req-f3e4d258-c67d-4072-ab33-68f7c7f5184e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9530d01a-c2a4-44f2-a631-31faa3921205", "name": "network-vif-plugged", "status": "completed", "tag": "4641460f-7920-49e5-b889-55969872b7b8"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:06:55.000466 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-3479e22c-8b17-4f3d-a18d-388f52348e0f req-f3e4d258-c67d-4072-ab33-68f7c7f5184e service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:55.004025 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-3479e22c-8b17-4f3d-a18d-388f52348e0f req-f3e4d258-c67d-4072-ab33-68f7c7f5184e service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:55.004528 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-3479e22c-8b17-4f3d-a18d-388f52348e0f req-f3e4d258-c67d-4072-ab33-68f7c7f5184e service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:55.017985 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-3479e22c-8b17-4f3d-a18d-388f52348e0f req-f3e4d258-c67d-4072-ab33-68f7c7f5184e service nova] Creating event network-vif-plugged:4641460f-7920-49e5-b889-55969872b7b8 for instance 9530d01a-c2a4-44f2-a631-31faa3921205 on hv-cinder-85236 Aug 26 11:06:55.042033 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-3479e22c-8b17-4f3d-a18d-388f52348e0f req-f3e4d258-c67d-4072-ab33-68f7c7f5184e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070529 Aug 26 11:06:55.043044 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 128/266] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:06:55.213341 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-14e9da0f-a671-4e6f-b31d-e8e747ced283 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4082c4b3-2f5f-4500-8047-1bac6e487c44"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:06:55.217150 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-14e9da0f-a671-4e6f-b31d-e8e747ced283 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:55.225258 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14e9da0f-a671-4e6f-b31d-e8e747ced283 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:55.225769 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14e9da0f-a671-4e6f-b31d-e8e747ced283 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:55.226237 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14e9da0f-a671-4e6f-b31d-e8e747ced283 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:55.226969 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14e9da0f-a671-4e6f-b31d-e8e747ced283 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:55.227411 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14e9da0f-a671-4e6f-b31d-e8e747ced283 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:55.227847 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14e9da0f-a671-4e6f-b31d-e8e747ced283 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:55.528130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-dcdd0b07-cfff-43e7-b63b-5f5826143658 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:55.528775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-dcdd0b07-cfff-43e7-b63b-5f5826143658 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:55.535053 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dcdd0b07-cfff-43e7-b63b-5f5826143658 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:55.535539 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dcdd0b07-cfff-43e7-b63b-5f5826143658 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:55.536639 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dcdd0b07-cfff-43e7-b63b-5f5826143658 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:55.537347 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dcdd0b07-cfff-43e7-b63b-5f5826143658 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:55.537802 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dcdd0b07-cfff-43e7-b63b-5f5826143658 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:55.538405 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dcdd0b07-cfff-43e7-b63b-5f5826143658 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:55.677505 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-dcdd0b07-cfff-43e7-b63b-5f5826143658 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:55.686371 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-dcdd0b07-cfff-43e7-b63b-5f5826143658 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1356 microversion: 2.1 time: 0.162895 Aug 26 11:06:55.686966 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 129/267] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:55 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1356 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:06:55.691855 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-481b0510-4851-43b4-ba20-ce388af2978d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:55.693303 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-481b0510-4851-43b4-ba20-ce388af2978d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:55.700895 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-481b0510-4851-43b4-ba20-ce388af2978d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:55.701381 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-481b0510-4851-43b4-ba20-ce388af2978d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:55.701811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-481b0510-4851-43b4-ba20-ce388af2978d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:55.702543 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-481b0510-4851-43b4-ba20-ce388af2978d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:55.703019 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-481b0510-4851-43b4-ba20-ce388af2978d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:55.703574 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-481b0510-4851-43b4-ba20-ce388af2978d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:55.847505 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-481b0510-4851-43b4-ba20-ce388af2978d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:55.856771 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-481b0510-4851-43b4-ba20-ce388af2978d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:55.859418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-481b0510-4851-43b4-ba20-ce388af2978d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:55.861012 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-481b0510-4851-43b4-ba20-ce388af2978d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.173101 Aug 26 11:06:55.861948 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 130/268] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:06:55 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:06:55.881116 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b1fcb45f-c1e4-40e7-82dc-ea7a39074caa tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:55.881643 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b1fcb45f-c1e4-40e7-82dc-ea7a39074caa tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:55.887857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1fcb45f-c1e4-40e7-82dc-ea7a39074caa tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:55.888349 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1fcb45f-c1e4-40e7-82dc-ea7a39074caa tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:55.888787 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1fcb45f-c1e4-40e7-82dc-ea7a39074caa tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:55.889492 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1fcb45f-c1e4-40e7-82dc-ea7a39074caa tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:55.889946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1fcb45f-c1e4-40e7-82dc-ea7a39074caa tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:55.890424 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1fcb45f-c1e4-40e7-82dc-ea7a39074caa tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:56.029577 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b1fcb45f-c1e4-40e7-82dc-ea7a39074caa tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:56.039432 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b1fcb45f-c1e4-40e7-82dc-ea7a39074caa tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1369 microversion: 2.1 time: 0.162809 Aug 26 11:06:56.055341 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 131/269] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:55 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:56.055341 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-d56278ab-70bd-4a88-947b-1bd128201473 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:56.055341 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-d56278ab-70bd-4a88-947b-1bd128201473 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:56.061765 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d56278ab-70bd-4a88-947b-1bd128201473 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:56.062302 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d56278ab-70bd-4a88-947b-1bd128201473 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:56.062748 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d56278ab-70bd-4a88-947b-1bd128201473 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:56.063459 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d56278ab-70bd-4a88-947b-1bd128201473 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:56.063914 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d56278ab-70bd-4a88-947b-1bd128201473 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:56.064344 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d56278ab-70bd-4a88-947b-1bd128201473 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:56.139407 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-d56278ab-70bd-4a88-947b-1bd128201473 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:56.148126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-d56278ab-70bd-4a88-947b-1bd128201473 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1267 microversion: 2.1 time: 0.101819 Aug 26 11:06:56.148714 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 132/270] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:56 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:56.708580 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-8dceae86-5a17-402a-a254-9c0c16d8731a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:56.710665 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-8dceae86-5a17-402a-a254-9c0c16d8731a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:56.721045 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8dceae86-5a17-402a-a254-9c0c16d8731a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:56.721652 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8dceae86-5a17-402a-a254-9c0c16d8731a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:56.722139 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8dceae86-5a17-402a-a254-9c0c16d8731a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:56.722956 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8dceae86-5a17-402a-a254-9c0c16d8731a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:56.724174 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8dceae86-5a17-402a-a254-9c0c16d8731a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:56.724422 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8dceae86-5a17-402a-a254-9c0c16d8731a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:56.941136 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8dceae86-5a17-402a-a254-9c0c16d8731a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:56.952387 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-8dceae86-5a17-402a-a254-9c0c16d8731a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1356 microversion: 2.1 time: 0.247764 Aug 26 11:06:56.955772 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 133/271] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:56 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1356 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:06:56.970501 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-de8723f9-95c0-494c-9570-faca6a372298 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:56.971838 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-de8723f9-95c0-494c-9570-faca6a372298 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:56.981317 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-de8723f9-95c0-494c-9570-faca6a372298 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:56.982437 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-de8723f9-95c0-494c-9570-faca6a372298 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:56.983128 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-de8723f9-95c0-494c-9570-faca6a372298 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:56.984338 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-de8723f9-95c0-494c-9570-faca6a372298 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:56.984874 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-de8723f9-95c0-494c-9570-faca6a372298 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:56.985375 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-de8723f9-95c0-494c-9570-faca6a372298 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:57.185803 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-de8723f9-95c0-494c-9570-faca6a372298 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:57.190295 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=100 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:06:57.199557 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-de8723f9-95c0-494c-9570-faca6a372298 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:57.201181 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-de8723f9-95c0-494c-9570-faca6a372298 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:57.202777 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-de8723f9-95c0-494c-9570-faca6a372298 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.245252 Aug 26 11:06:57.203649 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 134/272] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:06:56 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:06:57.226139 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-70715ade-3b6c-4125-8bf2-c1edfd5ae846 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:57.227097 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-70715ade-3b6c-4125-8bf2-c1edfd5ae846 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:57.236922 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-70715ade-3b6c-4125-8bf2-c1edfd5ae846 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:57.237424 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-70715ade-3b6c-4125-8bf2-c1edfd5ae846 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:57.237860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-70715ade-3b6c-4125-8bf2-c1edfd5ae846 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:57.238598 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-70715ade-3b6c-4125-8bf2-c1edfd5ae846 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:57.239576 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-70715ade-3b6c-4125-8bf2-c1edfd5ae846 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:57.240351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-70715ade-3b6c-4125-8bf2-c1edfd5ae846 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:57.401699 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-70715ade-3b6c-4125-8bf2-c1edfd5ae846 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:57.409861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-70715ade-3b6c-4125-8bf2-c1edfd5ae846 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1369 microversion: 2.1 time: 0.204813 Aug 26 11:06:57.436742 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 135/273] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:57 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1369 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:57.436742 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0038cf16-aca0-432e-99c0-dc0623efd5a0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:57.436742 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0038cf16-aca0-432e-99c0-dc0623efd5a0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:57.440863 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0038cf16-aca0-432e-99c0-dc0623efd5a0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:57.441401 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0038cf16-aca0-432e-99c0-dc0623efd5a0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:57.441931 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0038cf16-aca0-432e-99c0-dc0623efd5a0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:57.443650 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0038cf16-aca0-432e-99c0-dc0623efd5a0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:57.444270 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0038cf16-aca0-432e-99c0-dc0623efd5a0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:57.444698 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0038cf16-aca0-432e-99c0-dc0623efd5a0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:57.559250 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0038cf16-aca0-432e-99c0-dc0623efd5a0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:57.566820 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0038cf16-aca0-432e-99c0-dc0623efd5a0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1267 microversion: 2.1 time: 0.142631 Aug 26 11:06:57.568022 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 136/274] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:57 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:57.982608 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5c5c954f-c834-4ad8-94b1-d6cb6885d2ab tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:57.983382 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5c5c954f-c834-4ad8-94b1-d6cb6885d2ab tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:57.992124 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5c5c954f-c834-4ad8-94b1-d6cb6885d2ab tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:57.992625 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5c5c954f-c834-4ad8-94b1-d6cb6885d2ab tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:57.993323 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5c5c954f-c834-4ad8-94b1-d6cb6885d2ab tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:57.994066 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5c5c954f-c834-4ad8-94b1-d6cb6885d2ab tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:57.994552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5c5c954f-c834-4ad8-94b1-d6cb6885d2ab tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:57.994978 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5c5c954f-c834-4ad8-94b1-d6cb6885d2ab tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:58.197531 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5c5c954f-c834-4ad8-94b1-d6cb6885d2ab tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:58.208937 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5c5c954f-c834-4ad8-94b1-d6cb6885d2ab tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1356 microversion: 2.1 time: 0.229320 Aug 26 11:06:58.218025 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 137/275] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:57 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1356 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:06:58.227157 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f17b3303-1701-4c6f-8593-99eb6e73811b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:58.227770 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f17b3303-1701-4c6f-8593-99eb6e73811b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:58.234332 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f17b3303-1701-4c6f-8593-99eb6e73811b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:58.234901 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f17b3303-1701-4c6f-8593-99eb6e73811b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:58.235408 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f17b3303-1701-4c6f-8593-99eb6e73811b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:58.236309 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f17b3303-1701-4c6f-8593-99eb6e73811b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:58.236796 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f17b3303-1701-4c6f-8593-99eb6e73811b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:58.237220 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f17b3303-1701-4c6f-8593-99eb6e73811b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:58.392724 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f17b3303-1701-4c6f-8593-99eb6e73811b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:58.403030 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f17b3303-1701-4c6f-8593-99eb6e73811b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:58.404867 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f17b3303-1701-4c6f-8593-99eb6e73811b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:58.406311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f17b3303-1701-4c6f-8593-99eb6e73811b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.183297 Aug 26 11:06:58.422562 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 138/276] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:06:58 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:06:58.447707 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-40d308d9-93ac-48d2-8e2e-c8354414098c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:58.448496 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-40d308d9-93ac-48d2-8e2e-c8354414098c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:58.454819 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-40d308d9-93ac-48d2-8e2e-c8354414098c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:58.455315 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-40d308d9-93ac-48d2-8e2e-c8354414098c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:58.455749 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-40d308d9-93ac-48d2-8e2e-c8354414098c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:58.456597 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-40d308d9-93ac-48d2-8e2e-c8354414098c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:58.457058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-40d308d9-93ac-48d2-8e2e-c8354414098c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:58.457483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-40d308d9-93ac-48d2-8e2e-c8354414098c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:58.627667 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-40d308d9-93ac-48d2-8e2e-c8354414098c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:58.637243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-40d308d9-93ac-48d2-8e2e-c8354414098c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1369 microversion: 2.1 time: 0.193712 Aug 26 11:06:58.646069 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 139/277] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:58 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1369 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:58.646069 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3b68ff8e-4d0c-4c4f-9116-9f80c5cc0e27 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:58.646069 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-3b68ff8e-4d0c-4c4f-9116-9f80c5cc0e27 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:58.650393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3b68ff8e-4d0c-4c4f-9116-9f80c5cc0e27 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:58.650985 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3b68ff8e-4d0c-4c4f-9116-9f80c5cc0e27 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:58.651426 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3b68ff8e-4d0c-4c4f-9116-9f80c5cc0e27 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:58.652159 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3b68ff8e-4d0c-4c4f-9116-9f80c5cc0e27 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:58.652620 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3b68ff8e-4d0c-4c4f-9116-9f80c5cc0e27 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:58.653040 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3b68ff8e-4d0c-4c4f-9116-9f80c5cc0e27 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:58.724720 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-3b68ff8e-4d0c-4c4f-9116-9f80c5cc0e27 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:58.735826 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-3b68ff8e-4d0c-4c4f-9116-9f80c5cc0e27 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1267 microversion: 2.1 time: 0.096703 Aug 26 11:06:58.736661 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 140/278] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:58 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:59.231481 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-be449afc-8c38-49a2-bb21-607d7ad0fcf7 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:59.232080 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-be449afc-8c38-49a2-bb21-607d7ad0fcf7 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:59.244895 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-be449afc-8c38-49a2-bb21-607d7ad0fcf7 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:59.245313 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-be449afc-8c38-49a2-bb21-607d7ad0fcf7 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:59.245919 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-be449afc-8c38-49a2-bb21-607d7ad0fcf7 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:59.246826 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-be449afc-8c38-49a2-bb21-607d7ad0fcf7 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:59.247282 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-be449afc-8c38-49a2-bb21-607d7ad0fcf7 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:59.247865 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-be449afc-8c38-49a2-bb21-607d7ad0fcf7 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:59.430082 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-be449afc-8c38-49a2-bb21-607d7ad0fcf7 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:59.440098 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-be449afc-8c38-49a2-bb21-607d7ad0fcf7 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1356 microversion: 2.1 time: 0.212398 Aug 26 11:06:59.455261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 141/279] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:59 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1356 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:06:59.455261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f0aa8358-eee9-4c31-8376-da0351c70bd2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:59.455261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f0aa8358-eee9-4c31-8376-da0351c70bd2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:59.455261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f0aa8358-eee9-4c31-8376-da0351c70bd2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:59.455711 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f0aa8358-eee9-4c31-8376-da0351c70bd2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:59.456158 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f0aa8358-eee9-4c31-8376-da0351c70bd2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:59.457004 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f0aa8358-eee9-4c31-8376-da0351c70bd2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:59.457467 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f0aa8358-eee9-4c31-8376-da0351c70bd2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:59.458482 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f0aa8358-eee9-4c31-8376-da0351c70bd2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:59.661181 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f0aa8358-eee9-4c31-8376-da0351c70bd2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:59.670770 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f0aa8358-eee9-4c31-8376-da0351c70bd2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:59.672158 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f0aa8358-eee9-4c31-8376-da0351c70bd2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:59.673484 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f0aa8358-eee9-4c31-8376-da0351c70bd2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.231040 Aug 26 11:06:59.686039 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 142/280] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:06:59 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:06:59.686039 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-69ee8cae-0e53-4302-a2fe-ef1e7c327284 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:59.686039 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-69ee8cae-0e53-4302-a2fe-ef1e7c327284 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:59.686039 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-69ee8cae-0e53-4302-a2fe-ef1e7c327284 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:59.686502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-69ee8cae-0e53-4302-a2fe-ef1e7c327284 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:59.686590 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-69ee8cae-0e53-4302-a2fe-ef1e7c327284 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:59.687312 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-69ee8cae-0e53-4302-a2fe-ef1e7c327284 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:59.687776 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-69ee8cae-0e53-4302-a2fe-ef1e7c327284 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:59.688208 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-69ee8cae-0e53-4302-a2fe-ef1e7c327284 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:59.904969 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-69ee8cae-0e53-4302-a2fe-ef1e7c327284 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:06:59.914605 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-69ee8cae-0e53-4302-a2fe-ef1e7c327284 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1369 microversion: 2.1 time: 0.239387 Aug 26 11:06:59.915182 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 143/281] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:59 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1369 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:06:59.922000 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-25bbe8b2-1d5d-4ef3-9999-1b2a7f54381f tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:06:59.923930 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-25bbe8b2-1d5d-4ef3-9999-1b2a7f54381f tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:06:59.932329 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-25bbe8b2-1d5d-4ef3-9999-1b2a7f54381f tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:59.932329 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-25bbe8b2-1d5d-4ef3-9999-1b2a7f54381f tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:59.932329 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-25bbe8b2-1d5d-4ef3-9999-1b2a7f54381f tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:06:59.933097 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-25bbe8b2-1d5d-4ef3-9999-1b2a7f54381f tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:06:59.933595 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-25bbe8b2-1d5d-4ef3-9999-1b2a7f54381f tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:06:59.934811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-25bbe8b2-1d5d-4ef3-9999-1b2a7f54381f tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:00.022691 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-25bbe8b2-1d5d-4ef3-9999-1b2a7f54381f tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:00.033409 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-25bbe8b2-1d5d-4ef3-9999-1b2a7f54381f tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1267 microversion: 2.1 time: 0.116734 Aug 26 11:07:00.038630 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 144/282] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:06:59 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1267 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:00.077178 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:00.271443 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=14 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:00.464491 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-7d414e0f-f335-4f3c-9181-aaf2bc4a70bf tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:00.465114 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-7d414e0f-f335-4f3c-9181-aaf2bc4a70bf tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:00.471787 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d414e0f-f335-4f3c-9181-aaf2bc4a70bf tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:00.472103 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d414e0f-f335-4f3c-9181-aaf2bc4a70bf tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:00.472537 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d414e0f-f335-4f3c-9181-aaf2bc4a70bf tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:00.473344 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d414e0f-f335-4f3c-9181-aaf2bc4a70bf tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:00.473931 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d414e0f-f335-4f3c-9181-aaf2bc4a70bf tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:00.474395 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d414e0f-f335-4f3c-9181-aaf2bc4a70bf tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:00.616500 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7d414e0f-f335-4f3c-9181-aaf2bc4a70bf tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:00.624810 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-7d414e0f-f335-4f3c-9181-aaf2bc4a70bf tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1356 microversion: 2.1 time: 0.164169 Aug 26 11:07:00.625398 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 145/283] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:00 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:00.701063 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-865a8975-27be-4df7-960e-a9dfee4a0317 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:00.701616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-865a8975-27be-4df7-960e-a9dfee4a0317 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:00.707566 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-865a8975-27be-4df7-960e-a9dfee4a0317 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:00.708178 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-865a8975-27be-4df7-960e-a9dfee4a0317 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:00.708609 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-865a8975-27be-4df7-960e-a9dfee4a0317 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:00.709313 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-865a8975-27be-4df7-960e-a9dfee4a0317 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:00.709767 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-865a8975-27be-4df7-960e-a9dfee4a0317 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:00.710222 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-865a8975-27be-4df7-960e-a9dfee4a0317 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:00.857270 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-865a8975-27be-4df7-960e-a9dfee4a0317 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:00.867353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-865a8975-27be-4df7-960e-a9dfee4a0317 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:00.869271 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-865a8975-27be-4df7-960e-a9dfee4a0317 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:00.871178 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-865a8975-27be-4df7-960e-a9dfee4a0317 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.174270 Aug 26 11:07:00.881031 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 146/284] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:00 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:07:00.942662 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-99991d90-ae01-4a04-9d91-f4f2e2995803 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:00.943318 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-99991d90-ae01-4a04-9d91-f4f2e2995803 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:00.949190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-99991d90-ae01-4a04-9d91-f4f2e2995803 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:00.949726 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-99991d90-ae01-4a04-9d91-f4f2e2995803 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:00.950192 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-99991d90-ae01-4a04-9d91-f4f2e2995803 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:00.950878 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-99991d90-ae01-4a04-9d91-f4f2e2995803 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:00.951379 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-99991d90-ae01-4a04-9d91-f4f2e2995803 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:00.951773 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-99991d90-ae01-4a04-9d91-f4f2e2995803 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:01.090739 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-99991d90-ae01-4a04-9d91-f4f2e2995803 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:01.099499 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-99991d90-ae01-4a04-9d91-f4f2e2995803 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1369 microversion: 2.1 time: 0.159973 Aug 26 11:07:01.100084 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 147/285] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:00 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:01.105208 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-ae2d2a82-7558-44ba-a1a8-0089933698f0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:01.105831 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-ae2d2a82-7558-44ba-a1a8-0089933698f0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:01.112750 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ae2d2a82-7558-44ba-a1a8-0089933698f0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:01.113279 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ae2d2a82-7558-44ba-a1a8-0089933698f0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:01.113719 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ae2d2a82-7558-44ba-a1a8-0089933698f0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:01.115266 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ae2d2a82-7558-44ba-a1a8-0089933698f0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:01.115732 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ae2d2a82-7558-44ba-a1a8-0089933698f0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:01.116229 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ae2d2a82-7558-44ba-a1a8-0089933698f0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:01.185708 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-ae2d2a82-7558-44ba-a1a8-0089933698f0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:01.193471 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-ae2d2a82-7558-44ba-a1a8-0089933698f0 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1267 microversion: 2.1 time: 0.092416 Aug 26 11:07:01.194065 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 148/286] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:01 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:01.646223 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-676dd379-5665-43e7-950f-c69af5a89ffe tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:01.647205 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-676dd379-5665-43e7-950f-c69af5a89ffe tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:01.653539 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-676dd379-5665-43e7-950f-c69af5a89ffe tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:01.654071 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-676dd379-5665-43e7-950f-c69af5a89ffe tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:01.654600 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-676dd379-5665-43e7-950f-c69af5a89ffe tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:01.655503 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-676dd379-5665-43e7-950f-c69af5a89ffe tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:01.655966 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-676dd379-5665-43e7-950f-c69af5a89ffe tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:01.656395 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-676dd379-5665-43e7-950f-c69af5a89ffe tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:01.802886 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-676dd379-5665-43e7-950f-c69af5a89ffe tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:01.812240 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-676dd379-5665-43e7-950f-c69af5a89ffe tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1356 microversion: 2.1 time: 0.170502 Aug 26 11:07:01.813252 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 149/287] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:01 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:01.894745 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3993fff2-1fc5-4170-b99e-aa93a6d78fd4 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:01.896920 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-3993fff2-1fc5-4170-b99e-aa93a6d78fd4 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:01.903354 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3993fff2-1fc5-4170-b99e-aa93a6d78fd4 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:01.903844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3993fff2-1fc5-4170-b99e-aa93a6d78fd4 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:01.904283 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3993fff2-1fc5-4170-b99e-aa93a6d78fd4 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:01.904990 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3993fff2-1fc5-4170-b99e-aa93a6d78fd4 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:01.905443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3993fff2-1fc5-4170-b99e-aa93a6d78fd4 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:01.905869 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3993fff2-1fc5-4170-b99e-aa93a6d78fd4 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:02.053530 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-3993fff2-1fc5-4170-b99e-aa93a6d78fd4 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:02.063469 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-3993fff2-1fc5-4170-b99e-aa93a6d78fd4 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:02.065136 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-3993fff2-1fc5-4170-b99e-aa93a6d78fd4 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:02.066453 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-3993fff2-1fc5-4170-b99e-aa93a6d78fd4 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.175916 Aug 26 11:07:02.067678 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 150/288] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:01 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:07:02.122225 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b2f0b10e-bcff-42e9-911e-58bb5dab2127 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:02.122957 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b2f0b10e-bcff-42e9-911e-58bb5dab2127 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:02.128946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2f0b10e-bcff-42e9-911e-58bb5dab2127 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:02.129458 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2f0b10e-bcff-42e9-911e-58bb5dab2127 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:02.129898 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2f0b10e-bcff-42e9-911e-58bb5dab2127 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:02.130611 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2f0b10e-bcff-42e9-911e-58bb5dab2127 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:02.131061 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2f0b10e-bcff-42e9-911e-58bb5dab2127 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:02.131487 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2f0b10e-bcff-42e9-911e-58bb5dab2127 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:02.147209 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=100 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:02.156377 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=4 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:02.274559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b2f0b10e-bcff-42e9-911e-58bb5dab2127 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:02.282866 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b2f0b10e-bcff-42e9-911e-58bb5dab2127 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1369 microversion: 2.1 time: 0.164973 Aug 26 11:07:02.283441 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 151/289] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:02 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1369 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:02.289374 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-6930f6d3-451f-4679-90f6-fcad1967c78c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:02.290014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-6930f6d3-451f-4679-90f6-fcad1967c78c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:02.297736 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6930f6d3-451f-4679-90f6-fcad1967c78c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:02.298324 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6930f6d3-451f-4679-90f6-fcad1967c78c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:02.299998 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6930f6d3-451f-4679-90f6-fcad1967c78c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:02.299998 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6930f6d3-451f-4679-90f6-fcad1967c78c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:02.300704 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6930f6d3-451f-4679-90f6-fcad1967c78c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:02.302245 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6930f6d3-451f-4679-90f6-fcad1967c78c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:02.365365 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6930f6d3-451f-4679-90f6-fcad1967c78c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:02.373498 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-6930f6d3-451f-4679-90f6-fcad1967c78c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1267 microversion: 2.1 time: 0.089054 Aug 26 11:07:02.374278 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 152/290] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:02 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:02.834221 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3f760525-055b-45a6-bbb3-14bec787e550 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:02.835256 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-3f760525-055b-45a6-bbb3-14bec787e550 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:02.837255 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=18 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:02.843049 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3f760525-055b-45a6-bbb3-14bec787e550 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:02.843682 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3f760525-055b-45a6-bbb3-14bec787e550 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:02.844373 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3f760525-055b-45a6-bbb3-14bec787e550 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:02.845199 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3f760525-055b-45a6-bbb3-14bec787e550 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:02.845716 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3f760525-055b-45a6-bbb3-14bec787e550 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:02.846268 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3f760525-055b-45a6-bbb3-14bec787e550 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:03.024417 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-3f760525-055b-45a6-bbb3-14bec787e550 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:03.033289 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-3f760525-055b-45a6-bbb3-14bec787e550 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1356 microversion: 2.1 time: 0.203766 Aug 26 11:07:03.034149 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 153/291] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:02 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1356 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:03.091121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4d0a3749-4a23-481d-a888-e71a84dd42f0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:03.091857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4d0a3749-4a23-481d-a888-e71a84dd42f0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:03.100050 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4d0a3749-4a23-481d-a888-e71a84dd42f0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:03.100802 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4d0a3749-4a23-481d-a888-e71a84dd42f0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:03.101312 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4d0a3749-4a23-481d-a888-e71a84dd42f0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:03.102279 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4d0a3749-4a23-481d-a888-e71a84dd42f0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:03.102805 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4d0a3749-4a23-481d-a888-e71a84dd42f0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:03.103300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4d0a3749-4a23-481d-a888-e71a84dd42f0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:03.238472 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4d0a3749-4a23-481d-a888-e71a84dd42f0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:03.247459 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4d0a3749-4a23-481d-a888-e71a84dd42f0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:03.248927 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4d0a3749-4a23-481d-a888-e71a84dd42f0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:03.250161 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4d0a3749-4a23-481d-a888-e71a84dd42f0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.163989 Aug 26 11:07:03.250720 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 154/292] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:03 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:07:03.304997 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-cf8332c5-066e-4315-b5c9-bc6a41d5004c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:03.305682 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-cf8332c5-066e-4315-b5c9-bc6a41d5004c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:03.311832 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf8332c5-066e-4315-b5c9-bc6a41d5004c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:03.312321 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf8332c5-066e-4315-b5c9-bc6a41d5004c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:03.312760 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf8332c5-066e-4315-b5c9-bc6a41d5004c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:03.313462 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf8332c5-066e-4315-b5c9-bc6a41d5004c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:03.313918 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf8332c5-066e-4315-b5c9-bc6a41d5004c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:03.314377 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf8332c5-066e-4315-b5c9-bc6a41d5004c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:03.445551 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-cf8332c5-066e-4315-b5c9-bc6a41d5004c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:03.453202 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-cf8332c5-066e-4315-b5c9-bc6a41d5004c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1369 microversion: 2.1 time: 0.152823 Aug 26 11:07:03.453773 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 155/293] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:03 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:03.458927 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-582147a9-a3d2-403b-a43a-fe5200f14552 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:03.459533 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-582147a9-a3d2-403b-a43a-fe5200f14552 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:03.465171 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-582147a9-a3d2-403b-a43a-fe5200f14552 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:03.465660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-582147a9-a3d2-403b-a43a-fe5200f14552 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:03.466134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-582147a9-a3d2-403b-a43a-fe5200f14552 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:03.466834 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-582147a9-a3d2-403b-a43a-fe5200f14552 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:03.467292 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-582147a9-a3d2-403b-a43a-fe5200f14552 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:03.467718 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-582147a9-a3d2-403b-a43a-fe5200f14552 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:03.532690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-582147a9-a3d2-403b-a43a-fe5200f14552 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:03.540770 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-582147a9-a3d2-403b-a43a-fe5200f14552 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1267 microversion: 2.1 time: 0.085966 Aug 26 11:07:03.541343 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 156/294] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:03 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:04.055338 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-9f0735c8-311c-493b-bbe8-4092f2dbe090 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:04.056719 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9f0735c8-311c-493b-bbe8-4092f2dbe090 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:04.059337 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:04.065447 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f0735c8-311c-493b-bbe8-4092f2dbe090 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:04.066196 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f0735c8-311c-493b-bbe8-4092f2dbe090 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:04.066863 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f0735c8-311c-493b-bbe8-4092f2dbe090 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:04.068509 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f0735c8-311c-493b-bbe8-4092f2dbe090 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:04.068976 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f0735c8-311c-493b-bbe8-4092f2dbe090 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:04.069368 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f0735c8-311c-493b-bbe8-4092f2dbe090 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:04.211815 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9f0735c8-311c-493b-bbe8-4092f2dbe090 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:04.219634 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-9f0735c8-311c-493b-bbe8-4092f2dbe090 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1356 microversion: 2.1 time: 0.168481 Aug 26 11:07:04.220208 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 157/295] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:04 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:04.274098 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-fb616ea3-ab0a-40b1-aedf-e57170af79d2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:04.274718 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-fb616ea3-ab0a-40b1-aedf-e57170af79d2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:04.280956 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fb616ea3-ab0a-40b1-aedf-e57170af79d2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:04.281796 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fb616ea3-ab0a-40b1-aedf-e57170af79d2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:04.282366 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fb616ea3-ab0a-40b1-aedf-e57170af79d2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:04.283080 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fb616ea3-ab0a-40b1-aedf-e57170af79d2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:04.283542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fb616ea3-ab0a-40b1-aedf-e57170af79d2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:04.284040 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fb616ea3-ab0a-40b1-aedf-e57170af79d2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:04.499999 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-fb616ea3-ab0a-40b1-aedf-e57170af79d2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:04.510791 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-fb616ea3-ab0a-40b1-aedf-e57170af79d2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:04.512266 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-fb616ea3-ab0a-40b1-aedf-e57170af79d2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:04.513459 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-fb616ea3-ab0a-40b1-aedf-e57170af79d2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1746 microversion: 2.20 time: 0.243355 Aug 26 11:07:04.514043 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 158/296] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:04 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1746 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:07:04.521847 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-75bbb877-fb1b-43e6-b8d1-3351ed036f73 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:04.522759 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-75bbb877-fb1b-43e6-b8d1-3351ed036f73 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:04.529273 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75bbb877-fb1b-43e6-b8d1-3351ed036f73 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:04.529925 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75bbb877-fb1b-43e6-b8d1-3351ed036f73 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:04.530555 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75bbb877-fb1b-43e6-b8d1-3351ed036f73 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:04.535780 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75bbb877-fb1b-43e6-b8d1-3351ed036f73 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:04.536593 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75bbb877-fb1b-43e6-b8d1-3351ed036f73 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:04.537256 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75bbb877-fb1b-43e6-b8d1-3351ed036f73 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:04.606541 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-14e9da0f-a671-4e6f-b31d-e8e747ced283 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "POST /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.399813 Aug 26 11:07:04.607878 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 139/297] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 11:06:55 2022] POST /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/os-volume_attachments => generated 194 bytes in 9402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:07:04.614792 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a6fa8d17-1720-4d64-9355-d9c062538108 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:04.615734 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a6fa8d17-1720-4d64-9355-d9c062538108 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:04.623328 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6fa8d17-1720-4d64-9355-d9c062538108 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:04.623941 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6fa8d17-1720-4d64-9355-d9c062538108 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:04.624380 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6fa8d17-1720-4d64-9355-d9c062538108 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:04.625205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6fa8d17-1720-4d64-9355-d9c062538108 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:04.625739 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6fa8d17-1720-4d64-9355-d9c062538108 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:04.626209 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6fa8d17-1720-4d64-9355-d9c062538108 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:04.728785 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a6fa8d17-1720-4d64-9355-d9c062538108 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:04.738867 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a6fa8d17-1720-4d64-9355-d9c062538108 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1285 microversion: 2.1 time: 0.129297 Aug 26 11:07:04.740147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 140/298] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:04 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:04.775195 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-75bbb877-fb1b-43e6-b8d1-3351ed036f73 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:04.783437 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-75bbb877-fb1b-43e6-b8d1-3351ed036f73 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1369 microversion: 2.1 time: 0.265832 Aug 26 11:07:04.784218 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 159/299] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:04 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1369 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:05.241232 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-562f2ea9-b838-44d0-b844-189b4357f3d2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:05.241844 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-562f2ea9-b838-44d0-b844-189b4357f3d2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:05.248598 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-562f2ea9-b838-44d0-b844-189b4357f3d2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:05.249079 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-562f2ea9-b838-44d0-b844-189b4357f3d2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:05.249516 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-562f2ea9-b838-44d0-b844-189b4357f3d2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:05.250236 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-562f2ea9-b838-44d0-b844-189b4357f3d2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:05.250690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-562f2ea9-b838-44d0-b844-189b4357f3d2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:05.251108 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-562f2ea9-b838-44d0-b844-189b4357f3d2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:05.382990 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-562f2ea9-b838-44d0-b844-189b4357f3d2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:05.390581 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-562f2ea9-b838-44d0-b844-189b4357f3d2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1356 microversion: 2.1 time: 0.153751 Aug 26 11:07:05.391385 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 141/300] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:05 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:05.537898 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1f746c61-3995-46d1-81c5-d0b4b4000396 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:05.538547 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-1f746c61-3995-46d1-81c5-d0b4b4000396 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:05.554949 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1f746c61-3995-46d1-81c5-d0b4b4000396 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:05.555462 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1f746c61-3995-46d1-81c5-d0b4b4000396 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:05.555966 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1f746c61-3995-46d1-81c5-d0b4b4000396 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:05.556949 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1f746c61-3995-46d1-81c5-d0b4b4000396 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:05.557490 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1f746c61-3995-46d1-81c5-d0b4b4000396 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:05.558116 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1f746c61-3995-46d1-81c5-d0b4b4000396 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:05.762086 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-177b6848-c6b0-47a2-901d-e63912c24c39 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:05.762831 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-177b6848-c6b0-47a2-901d-e63912c24c39 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:05.772647 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-177b6848-c6b0-47a2-901d-e63912c24c39 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:05.773857 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-177b6848-c6b0-47a2-901d-e63912c24c39 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:05.774329 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-177b6848-c6b0-47a2-901d-e63912c24c39 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:05.775366 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-177b6848-c6b0-47a2-901d-e63912c24c39 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:05.775871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-177b6848-c6b0-47a2-901d-e63912c24c39 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:05.776351 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-177b6848-c6b0-47a2-901d-e63912c24c39 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:05.829120 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1f746c61-3995-46d1-81c5-d0b4b4000396 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:05.839763 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1f746c61-3995-46d1-81c5-d0b4b4000396 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:05.846331 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1f746c61-3995-46d1-81c5-d0b4b4000396 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:05.847545 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1f746c61-3995-46d1-81c5-d0b4b4000396 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1746 microversion: 2.20 time: 0.314352 Aug 26 11:07:05.850922 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 160/301] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:05 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1746 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:05.862129 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-13e7bcfc-c275-48c7-bf2b-9278a4624c1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:05.863000 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-13e7bcfc-c275-48c7-bf2b-9278a4624c1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:05.881109 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13e7bcfc-c275-48c7-bf2b-9278a4624c1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:05.881783 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13e7bcfc-c275-48c7-bf2b-9278a4624c1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:05.882429 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13e7bcfc-c275-48c7-bf2b-9278a4624c1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:05.883337 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13e7bcfc-c275-48c7-bf2b-9278a4624c1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:05.884000 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13e7bcfc-c275-48c7-bf2b-9278a4624c1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:05.884594 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13e7bcfc-c275-48c7-bf2b-9278a4624c1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:06.213263 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-177b6848-c6b0-47a2-901d-e63912c24c39 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:06.221696 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-177b6848-c6b0-47a2-901d-e63912c24c39 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1273 microversion: 2.1 time: 0.463659 Aug 26 11:07:06.224322 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 142/302] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:05 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1273 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:06.356445 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-13e7bcfc-c275-48c7-bf2b-9278a4624c1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:06.378848 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-13e7bcfc-c275-48c7-bf2b-9278a4624c1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1369 microversion: 2.1 time: 0.526409 Aug 26 11:07:06.380679 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 161/303] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:05 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1369 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:06.411980 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8cb49302-9345-406e-aa23-b6044a95d09b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:06.412593 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8cb49302-9345-406e-aa23-b6044a95d09b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:06.418769 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8cb49302-9345-406e-aa23-b6044a95d09b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:06.419285 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8cb49302-9345-406e-aa23-b6044a95d09b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:06.419712 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8cb49302-9345-406e-aa23-b6044a95d09b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:06.420394 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8cb49302-9345-406e-aa23-b6044a95d09b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:06.420843 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8cb49302-9345-406e-aa23-b6044a95d09b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:06.421278 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8cb49302-9345-406e-aa23-b6044a95d09b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:06.439511 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:06.575052 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8cb49302-9345-406e-aa23-b6044a95d09b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:06.583879 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8cb49302-9345-406e-aa23-b6044a95d09b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1356 microversion: 2.1 time: 0.175616 Aug 26 11:07:06.584744 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 143/304] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:06 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:06.877076 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5faf5f21-7a53-4eea-a2e0-45b83b522dd7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:06.878012 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5faf5f21-7a53-4eea-a2e0-45b83b522dd7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:06.885505 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5faf5f21-7a53-4eea-a2e0-45b83b522dd7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:06.886143 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5faf5f21-7a53-4eea-a2e0-45b83b522dd7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:06.886608 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5faf5f21-7a53-4eea-a2e0-45b83b522dd7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:06.887330 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5faf5f21-7a53-4eea-a2e0-45b83b522dd7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:06.887784 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5faf5f21-7a53-4eea-a2e0-45b83b522dd7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:06.888244 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5faf5f21-7a53-4eea-a2e0-45b83b522dd7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:07.024742 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5faf5f21-7a53-4eea-a2e0-45b83b522dd7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:07.032902 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5faf5f21-7a53-4eea-a2e0-45b83b522dd7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:07.034383 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5faf5f21-7a53-4eea-a2e0-45b83b522dd7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:07.035541 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5faf5f21-7a53-4eea-a2e0-45b83b522dd7 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1746 microversion: 2.20 time: 0.162711 Aug 26 11:07:07.036597 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 162/305] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:06 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:07.247715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4fc5052b-7220-4750-b908-d2ee31e65273 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:07.248329 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4fc5052b-7220-4750-b908-d2ee31e65273 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:07.255655 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4fc5052b-7220-4750-b908-d2ee31e65273 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:07.256180 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4fc5052b-7220-4750-b908-d2ee31e65273 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:07.256627 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4fc5052b-7220-4750-b908-d2ee31e65273 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:07.257354 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4fc5052b-7220-4750-b908-d2ee31e65273 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:07.257814 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4fc5052b-7220-4750-b908-d2ee31e65273 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:07.258944 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4fc5052b-7220-4750-b908-d2ee31e65273 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:07.393450 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4fc5052b-7220-4750-b908-d2ee31e65273 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:07.401805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4fc5052b-7220-4750-b908-d2ee31e65273 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1315 microversion: 2.1 time: 0.158370 Aug 26 11:07:07.402659 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 144/306] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:07 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:07.404510 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3fa289f5-134f-4250-960e-1fefe76be997 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:07.405187 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-3fa289f5-134f-4250-960e-1fefe76be997 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:07.412141 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3fa289f5-134f-4250-960e-1fefe76be997 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:07.412627 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3fa289f5-134f-4250-960e-1fefe76be997 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:07.413067 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3fa289f5-134f-4250-960e-1fefe76be997 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:07.413820 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3fa289f5-134f-4250-960e-1fefe76be997 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:07.414350 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3fa289f5-134f-4250-960e-1fefe76be997 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:07.414790 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3fa289f5-134f-4250-960e-1fefe76be997 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:07.550380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-3fa289f5-134f-4250-960e-1fefe76be997 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:07.559125 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-3fa289f5-134f-4250-960e-1fefe76be997 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1562 microversion: 2.1 time: 0.158571 Aug 26 11:07:07.559697 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 163/307] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:07 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:07.579648 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b2e4bc8c-a436-488b-a7fe-35db3785d315 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:07.580139 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b2e4bc8c-a436-488b-a7fe-35db3785d315 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:07.586170 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2e4bc8c-a436-488b-a7fe-35db3785d315 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:07.586658 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2e4bc8c-a436-488b-a7fe-35db3785d315 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:07.587092 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2e4bc8c-a436-488b-a7fe-35db3785d315 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:07.587777 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2e4bc8c-a436-488b-a7fe-35db3785d315 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:07.588233 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2e4bc8c-a436-488b-a7fe-35db3785d315 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:07.588655 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2e4bc8c-a436-488b-a7fe-35db3785d315 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:07.607272 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-dfd3ba13-cf37-41f2-9d25-e7c0c99bfb85 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:07.607988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-dfd3ba13-cf37-41f2-9d25-e7c0c99bfb85 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:07.614600 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dfd3ba13-cf37-41f2-9d25-e7c0c99bfb85 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:07.615172 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dfd3ba13-cf37-41f2-9d25-e7c0c99bfb85 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:07.615612 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dfd3ba13-cf37-41f2-9d25-e7c0c99bfb85 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:07.616315 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dfd3ba13-cf37-41f2-9d25-e7c0c99bfb85 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:07.616776 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dfd3ba13-cf37-41f2-9d25-e7c0c99bfb85 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:07.617201 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dfd3ba13-cf37-41f2-9d25-e7c0c99bfb85 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:07.675224 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b2e4bc8c-a436-488b-a7fe-35db3785d315 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099416 Aug 26 11:07:07.675826 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 145/308] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 26 11:07:07 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:07:07.768738 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-dfd3ba13-cf37-41f2-9d25-e7c0c99bfb85 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:07.776599 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-dfd3ba13-cf37-41f2-9d25-e7c0c99bfb85 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1356 microversion: 2.1 time: 0.173136 Aug 26 11:07:07.777193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 164/309] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:07 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:08.058920 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6289bc93-e04f-4c56-878a-611518820b28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:08.059531 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6289bc93-e04f-4c56-878a-611518820b28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:08.065501 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6289bc93-e04f-4c56-878a-611518820b28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:08.065997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6289bc93-e04f-4c56-878a-611518820b28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:08.066450 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6289bc93-e04f-4c56-878a-611518820b28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:08.068128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6289bc93-e04f-4c56-878a-611518820b28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:08.068689 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6289bc93-e04f-4c56-878a-611518820b28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:08.069115 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6289bc93-e04f-4c56-878a-611518820b28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:08.197790 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6289bc93-e04f-4c56-878a-611518820b28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:08.205889 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6289bc93-e04f-4c56-878a-611518820b28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:08.207362 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6289bc93-e04f-4c56-878a-611518820b28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:08.209109 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6289bc93-e04f-4c56-878a-611518820b28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1746 microversion: 2.20 time: 0.154265 Aug 26 11:07:08.209660 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 146/310] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:08 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:08.424321 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-8c7a69f7-f734-4368-b33d-1a7b2d224753 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:08.426058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-8c7a69f7-f734-4368-b33d-1a7b2d224753 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:08.439821 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8c7a69f7-f734-4368-b33d-1a7b2d224753 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:08.444213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8c7a69f7-f734-4368-b33d-1a7b2d224753 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:08.444812 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8c7a69f7-f734-4368-b33d-1a7b2d224753 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:08.445676 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8c7a69f7-f734-4368-b33d-1a7b2d224753 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:08.446279 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8c7a69f7-f734-4368-b33d-1a7b2d224753 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:08.446815 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8c7a69f7-f734-4368-b33d-1a7b2d224753 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:08.600722 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8c7a69f7-f734-4368-b33d-1a7b2d224753 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:08.609486 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-8c7a69f7-f734-4368-b33d-1a7b2d224753 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1315 microversion: 2.1 time: 0.189446 Aug 26 11:07:08.610365 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 165/311] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:08 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:08.800340 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-37133a7c-fbaa-43b8-a457-6a81d6ad52d4 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:08.802408 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-37133a7c-fbaa-43b8-a457-6a81d6ad52d4 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:08.814458 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-37133a7c-fbaa-43b8-a457-6a81d6ad52d4 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:08.815729 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-37133a7c-fbaa-43b8-a457-6a81d6ad52d4 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:08.816426 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-37133a7c-fbaa-43b8-a457-6a81d6ad52d4 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:08.818898 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-37133a7c-fbaa-43b8-a457-6a81d6ad52d4 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:08.819647 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-37133a7c-fbaa-43b8-a457-6a81d6ad52d4 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:08.820486 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-37133a7c-fbaa-43b8-a457-6a81d6ad52d4 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:09.045826 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-bceea8d2-fa0d-417d-9035-0637df8a5fb3 req-41252f21-16bf-449f-a1af-48a684b3b02f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ae91d9-0521-4d14-b2b6-e56f249c4181", "name": "network-vif-plugged", "status": "completed", "tag": "36a4faa3-3a22-4156-8542-c0c5ea7e7f1c"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:09.046787 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-37133a7c-fbaa-43b8-a457-6a81d6ad52d4 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:09.058270 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-37133a7c-fbaa-43b8-a457-6a81d6ad52d4 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1356 microversion: 2.1 time: 0.264001 Aug 26 11:07:09.059220 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 147/312] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:08 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1356 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:09.067547 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-bceea8d2-fa0d-417d-9035-0637df8a5fb3 req-41252f21-16bf-449f-a1af-48a684b3b02f service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:09.068317 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-bceea8d2-fa0d-417d-9035-0637df8a5fb3 req-41252f21-16bf-449f-a1af-48a684b3b02f service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:09.068958 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-bceea8d2-fa0d-417d-9035-0637df8a5fb3 req-41252f21-16bf-449f-a1af-48a684b3b02f service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:09.096827 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-bceea8d2-fa0d-417d-9035-0637df8a5fb3 req-41252f21-16bf-449f-a1af-48a684b3b02f service nova] Creating event network-vif-plugged:36a4faa3-3a22-4156-8542-c0c5ea7e7f1c for instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 on hv-cinder-85236 Aug 26 11:07:09.103579 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-bceea8d2-fa0d-417d-9035-0637df8a5fb3 req-41252f21-16bf-449f-a1af-48a684b3b02f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062088 Aug 26 11:07:09.104485 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 166/313] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:07:09.231944 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5298f5d0-20de-41aa-85d8-55a7d02e56dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:09.232712 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5298f5d0-20de-41aa-85d8-55a7d02e56dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:09.239178 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5298f5d0-20de-41aa-85d8-55a7d02e56dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:09.240012 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5298f5d0-20de-41aa-85d8-55a7d02e56dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:09.240928 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5298f5d0-20de-41aa-85d8-55a7d02e56dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:09.241879 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5298f5d0-20de-41aa-85d8-55a7d02e56dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:09.242584 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5298f5d0-20de-41aa-85d8-55a7d02e56dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:09.243489 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5298f5d0-20de-41aa-85d8-55a7d02e56dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:09.432196 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5298f5d0-20de-41aa-85d8-55a7d02e56dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:09.442595 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5298f5d0-20de-41aa-85d8-55a7d02e56dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:09.444828 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5298f5d0-20de-41aa-85d8-55a7d02e56dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:09.446104 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5298f5d0-20de-41aa-85d8-55a7d02e56dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1741 microversion: 2.20 time: 0.218060 Aug 26 11:07:09.454318 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 148/314] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:09 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1741 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:09.606478 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-c6b5c958-c80a-4f17-8eb7-0374bde81ac7 req-0e979451-f001-4cb9-802b-35d91b9c8366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "304b1637-de58-42d2-8ae1-603821c8c782", "tag": "f30b2e93-d49f-40da-8153-b3c851cc68b4"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:09.630780 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-c6b5c958-c80a-4f17-8eb7-0374bde81ac7 req-0e979451-f001-4cb9-802b-35d91b9c8366 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:09.633922 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-49eafbf6-46c1-4b13-8503-ee03ef9e0974 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:09.634636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-49eafbf6-46c1-4b13-8503-ee03ef9e0974 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:09.635266 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-c6b5c958-c80a-4f17-8eb7-0374bde81ac7 req-0e979451-f001-4cb9-802b-35d91b9c8366 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:09.636444 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-c6b5c958-c80a-4f17-8eb7-0374bde81ac7 req-0e979451-f001-4cb9-802b-35d91b9c8366 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:09.654477 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49eafbf6-46c1-4b13-8503-ee03ef9e0974 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:09.659091 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49eafbf6-46c1-4b13-8503-ee03ef9e0974 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:09.660404 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49eafbf6-46c1-4b13-8503-ee03ef9e0974 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:09.662965 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49eafbf6-46c1-4b13-8503-ee03ef9e0974 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:09.663505 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49eafbf6-46c1-4b13-8503-ee03ef9e0974 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:09.665111 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49eafbf6-46c1-4b13-8503-ee03ef9e0974 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:09.674053 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-c6b5c958-c80a-4f17-8eb7-0374bde81ac7 req-0e979451-f001-4cb9-802b-35d91b9c8366 service nova] Creating event network-changed:f30b2e93-d49f-40da-8153-b3c851cc68b4 for instance 304b1637-de58-42d2-8ae1-603821c8c782 on hv-cinder-85236 Aug 26 11:07:09.686463 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-c6b5c958-c80a-4f17-8eb7-0374bde81ac7 req-0e979451-f001-4cb9-802b-35d91b9c8366 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091166 Aug 26 11:07:09.695724 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 167/315] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:07:10.004167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-49eafbf6-46c1-4b13-8503-ee03ef9e0974 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:10.020705 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-49eafbf6-46c1-4b13-8503-ee03ef9e0974 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1315 microversion: 2.1 time: 0.392794 Aug 26 11:07:10.023030 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 149/316] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:09 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:10.083421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-452660a1-a611-44cd-b095-44375340135d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:10.084807 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-452660a1-a611-44cd-b095-44375340135d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:10.121577 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-452660a1-a611-44cd-b095-44375340135d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:10.122646 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-452660a1-a611-44cd-b095-44375340135d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:10.123263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-452660a1-a611-44cd-b095-44375340135d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:10.125669 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-452660a1-a611-44cd-b095-44375340135d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:10.126378 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-452660a1-a611-44cd-b095-44375340135d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:10.130015 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-452660a1-a611-44cd-b095-44375340135d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:10.472314 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9444f8f6-c788-4323-882f-6b618ad70759 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:10.473280 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9444f8f6-c788-4323-882f-6b618ad70759 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:10.493797 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-452660a1-a611-44cd-b095-44375340135d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:10.497343 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9444f8f6-c788-4323-882f-6b618ad70759 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:10.498194 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9444f8f6-c788-4323-882f-6b618ad70759 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:10.500532 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9444f8f6-c788-4323-882f-6b618ad70759 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:10.510814 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-452660a1-a611-44cd-b095-44375340135d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1356 microversion: 2.1 time: 0.431730 Aug 26 11:07:10.511457 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9444f8f6-c788-4323-882f-6b618ad70759 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:10.512194 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9444f8f6-c788-4323-882f-6b618ad70759 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:10.512800 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9444f8f6-c788-4323-882f-6b618ad70759 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:10.514559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 168/317] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:10 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1356 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:10.718478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9444f8f6-c788-4323-882f-6b618ad70759 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:10.730788 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9444f8f6-c788-4323-882f-6b618ad70759 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:10.733156 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9444f8f6-c788-4323-882f-6b618ad70759 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:10.734638 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9444f8f6-c788-4323-882f-6b618ad70759 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1741 microversion: 2.20 time: 0.267818 Aug 26 11:07:10.752335 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 150/318] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:10 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1741 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:07:11.053671 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5d5f4a77-5d24-445b-b1a9-91d715f5d937 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:11.055677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5d5f4a77-5d24-445b-b1a9-91d715f5d937 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:11.073851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d5f4a77-5d24-445b-b1a9-91d715f5d937 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:11.074859 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d5f4a77-5d24-445b-b1a9-91d715f5d937 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:11.079180 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d5f4a77-5d24-445b-b1a9-91d715f5d937 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:11.080221 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d5f4a77-5d24-445b-b1a9-91d715f5d937 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:11.081452 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d5f4a77-5d24-445b-b1a9-91d715f5d937 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:11.082109 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d5f4a77-5d24-445b-b1a9-91d715f5d937 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:11.128901 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=100 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:11.162048 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-ee87ffff-03e5-4c42-a56e-1f43e57ec872 req-a3f97b72-01f1-4a42-ac15-9e8ae641edbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136f48c9-a521-4bc3-b6cc-98da91d02c49", "name": "network-vif-plugged", "status": "completed", "tag": "9431c858-ac93-4f2b-a673-fd8e539b68c8"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:11.190097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-ee87ffff-03e5-4c42-a56e-1f43e57ec872 req-a3f97b72-01f1-4a42-ac15-9e8ae641edbb service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:11.190597 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-ee87ffff-03e5-4c42-a56e-1f43e57ec872 req-a3f97b72-01f1-4a42-ac15-9e8ae641edbb service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:11.191032 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-ee87ffff-03e5-4c42-a56e-1f43e57ec872 req-a3f97b72-01f1-4a42-ac15-9e8ae641edbb service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:11.220328 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-ee87ffff-03e5-4c42-a56e-1f43e57ec872 req-a3f97b72-01f1-4a42-ac15-9e8ae641edbb service nova] Creating event network-vif-plugged:9431c858-ac93-4f2b-a673-fd8e539b68c8 for instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 on hv-cinder-85236 Aug 26 11:07:11.232947 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-ee87ffff-03e5-4c42-a56e-1f43e57ec872 req-a3f97b72-01f1-4a42-ac15-9e8ae641edbb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075860 Aug 26 11:07:11.238232 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 151/319] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:07:11.401648 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5d5f4a77-5d24-445b-b1a9-91d715f5d937 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:11.417235 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5d5f4a77-5d24-445b-b1a9-91d715f5d937 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1315 microversion: 2.1 time: 0.367967 Aug 26 11:07:11.431622 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 169/320] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:11 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:11.546459 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1f48a6f2-102c-4141-97ba-cccc7242871f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:11.549289 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1f48a6f2-102c-4141-97ba-cccc7242871f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:11.576305 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f48a6f2-102c-4141-97ba-cccc7242871f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:11.576880 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f48a6f2-102c-4141-97ba-cccc7242871f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:11.577433 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f48a6f2-102c-4141-97ba-cccc7242871f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:11.579713 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f48a6f2-102c-4141-97ba-cccc7242871f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:11.580199 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f48a6f2-102c-4141-97ba-cccc7242871f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:11.581136 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f48a6f2-102c-4141-97ba-cccc7242871f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:11.753311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-af0b7f65-273a-4666-b0a2-bf26aaf40d39 req-e3579e7e-dd16-4b33-bf0c-a0245881e901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9530d01a-c2a4-44f2-a631-31faa3921205", "tag": "4641460f-7920-49e5-b889-55969872b7b8"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:11.777660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-af0b7f65-273a-4666-b0a2-bf26aaf40d39 req-e3579e7e-dd16-4b33-bf0c-a0245881e901 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:11.790431 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-af0b7f65-273a-4666-b0a2-bf26aaf40d39 req-e3579e7e-dd16-4b33-bf0c-a0245881e901 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:11.791280 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-af0b7f65-273a-4666-b0a2-bf26aaf40d39 req-e3579e7e-dd16-4b33-bf0c-a0245881e901 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:11.804339 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-af0b7f65-273a-4666-b0a2-bf26aaf40d39 req-e3579e7e-dd16-4b33-bf0c-a0245881e901 service nova] Creating event network-changed:4641460f-7920-49e5-b889-55969872b7b8 for instance 9530d01a-c2a4-44f2-a631-31faa3921205 on hv-cinder-85236 Aug 26 11:07:11.819862 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-af0b7f65-273a-4666-b0a2-bf26aaf40d39 req-e3579e7e-dd16-4b33-bf0c-a0245881e901 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070088 Aug 26 11:07:11.820477 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 170/321] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:07:11.852450 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a979377c-c8a9-4387-aa22-1e73484576c0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:11.853481 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-a979377c-c8a9-4387-aa22-1e73484576c0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:11.866265 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a979377c-c8a9-4387-aa22-1e73484576c0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:11.872794 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a979377c-c8a9-4387-aa22-1e73484576c0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:11.873514 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a979377c-c8a9-4387-aa22-1e73484576c0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:11.874542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a979377c-c8a9-4387-aa22-1e73484576c0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:11.876320 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a979377c-c8a9-4387-aa22-1e73484576c0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:11.876931 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a979377c-c8a9-4387-aa22-1e73484576c0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:12.216575 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-a979377c-c8a9-4387-aa22-1e73484576c0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:12.227122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-a979377c-c8a9-4387-aa22-1e73484576c0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:12.232942 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-a979377c-c8a9-4387-aa22-1e73484576c0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:12.235016 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-a979377c-c8a9-4387-aa22-1e73484576c0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1741 microversion: 2.20 time: 0.413359 Aug 26 11:07:12.237732 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 171/322] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:11 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1741 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:12.339449 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1f48a6f2-102c-4141-97ba-cccc7242871f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:12.356371 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1f48a6f2-102c-4141-97ba-cccc7242871f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1356 microversion: 2.1 time: 0.814158 Aug 26 11:07:12.358955 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 152/323] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:11 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1356 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:12.441004 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-de6eb4b2-5835-43ce-aff1-1f53784b060c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:12.441631 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-de6eb4b2-5835-43ce-aff1-1f53784b060c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:12.455811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-de6eb4b2-5835-43ce-aff1-1f53784b060c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:12.456635 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-de6eb4b2-5835-43ce-aff1-1f53784b060c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:12.459022 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-de6eb4b2-5835-43ce-aff1-1f53784b060c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:12.461048 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-de6eb4b2-5835-43ce-aff1-1f53784b060c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:12.462431 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-de6eb4b2-5835-43ce-aff1-1f53784b060c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:12.463880 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-de6eb4b2-5835-43ce-aff1-1f53784b060c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:12.691764 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-de6eb4b2-5835-43ce-aff1-1f53784b060c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:12.704849 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-de6eb4b2-5835-43ce-aff1-1f53784b060c tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1315 microversion: 2.1 time: 0.267737 Aug 26 11:07:12.706125 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 172/324] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:12 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:13.266260 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-897c7998-42c5-43be-b0ed-0d307230ae7d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:13.266868 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-897c7998-42c5-43be-b0ed-0d307230ae7d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:13.278894 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:13.282973 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-897c7998-42c5-43be-b0ed-0d307230ae7d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:13.283747 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-897c7998-42c5-43be-b0ed-0d307230ae7d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:13.286417 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-897c7998-42c5-43be-b0ed-0d307230ae7d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:13.287158 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-897c7998-42c5-43be-b0ed-0d307230ae7d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:13.287689 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-897c7998-42c5-43be-b0ed-0d307230ae7d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:13.288021 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-897c7998-42c5-43be-b0ed-0d307230ae7d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:13.384181 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-fc481c5c-563e-4c5c-b48d-2b432cef9b7f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:13.385403 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-fc481c5c-563e-4c5c-b48d-2b432cef9b7f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:13.394493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fc481c5c-563e-4c5c-b48d-2b432cef9b7f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:13.399564 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fc481c5c-563e-4c5c-b48d-2b432cef9b7f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:13.401911 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fc481c5c-563e-4c5c-b48d-2b432cef9b7f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:13.404140 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fc481c5c-563e-4c5c-b48d-2b432cef9b7f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:13.406667 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fc481c5c-563e-4c5c-b48d-2b432cef9b7f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:13.407310 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fc481c5c-563e-4c5c-b48d-2b432cef9b7f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:13.701154 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-897c7998-42c5-43be-b0ed-0d307230ae7d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:13.720725 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-897c7998-42c5-43be-b0ed-0d307230ae7d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:13.729090 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-897c7998-42c5-43be-b0ed-0d307230ae7d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:13.731370 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-897c7998-42c5-43be-b0ed-0d307230ae7d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1741 microversion: 2.20 time: 0.469170 Aug 26 11:07:13.732335 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 153/325] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:13 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1741 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:13.734892 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-fc481c5c-563e-4c5c-b48d-2b432cef9b7f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:13.746310 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-fc481c5c-563e-4c5c-b48d-2b432cef9b7f tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1356 microversion: 2.1 time: 0.368985 Aug 26 11:07:13.751476 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-92ed1758-9c65-4196-a04d-dfc79134d343 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:13.752285 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-92ed1758-9c65-4196-a04d-dfc79134d343 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:13.762664 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 173/326] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:13 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1356 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:13.772867 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-92ed1758-9c65-4196-a04d-dfc79134d343 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:13.773532 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-92ed1758-9c65-4196-a04d-dfc79134d343 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:13.774611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-92ed1758-9c65-4196-a04d-dfc79134d343 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:13.775968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-92ed1758-9c65-4196-a04d-dfc79134d343 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:13.776803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-92ed1758-9c65-4196-a04d-dfc79134d343 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:13.777443 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-92ed1758-9c65-4196-a04d-dfc79134d343 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:13.960353 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-92ed1758-9c65-4196-a04d-dfc79134d343 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:13.969882 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-92ed1758-9c65-4196-a04d-dfc79134d343 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1315 microversion: 2.1 time: 0.235874 Aug 26 11:07:13.986033 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 154/327] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:13 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:14.758937 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-fb4b1410-8547-45e9-ba53-9d83b0c9faac tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:14.760803 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-fb4b1410-8547-45e9-ba53-9d83b0c9faac tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:14.775173 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fb4b1410-8547-45e9-ba53-9d83b0c9faac tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:14.776002 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fb4b1410-8547-45e9-ba53-9d83b0c9faac tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:14.776738 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fb4b1410-8547-45e9-ba53-9d83b0c9faac tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:14.778100 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fb4b1410-8547-45e9-ba53-9d83b0c9faac tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:14.778815 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fb4b1410-8547-45e9-ba53-9d83b0c9faac tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:14.779482 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fb4b1410-8547-45e9-ba53-9d83b0c9faac tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:14.845690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e0998f66-4acb-4aeb-b700-1d1122281cd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:14.846567 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e0998f66-4acb-4aeb-b700-1d1122281cd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:14.869245 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0998f66-4acb-4aeb-b700-1d1122281cd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:14.870732 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0998f66-4acb-4aeb-b700-1d1122281cd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:14.871645 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0998f66-4acb-4aeb-b700-1d1122281cd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:14.872648 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0998f66-4acb-4aeb-b700-1d1122281cd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:14.873351 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0998f66-4acb-4aeb-b700-1d1122281cd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:14.879760 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0998f66-4acb-4aeb-b700-1d1122281cd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:15.083642 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-fb4b1410-8547-45e9-ba53-9d83b0c9faac tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:15.105990 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-fb4b1410-8547-45e9-ba53-9d83b0c9faac tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:15.112578 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-fb4b1410-8547-45e9-ba53-9d83b0c9faac tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:15.114720 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-fb4b1410-8547-45e9-ba53-9d83b0c9faac tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1741 microversion: 2.20 time: 0.361903 Aug 26 11:07:15.117740 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 174/328] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:14 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1741 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:15.131336 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-9b7d27ef-012f-428d-ac2e-94550e0a7968 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:15.132237 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9b7d27ef-012f-428d-ac2e-94550e0a7968 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:15.149931 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b7d27ef-012f-428d-ac2e-94550e0a7968 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:15.150666 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b7d27ef-012f-428d-ac2e-94550e0a7968 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:15.151248 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b7d27ef-012f-428d-ac2e-94550e0a7968 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:15.152198 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b7d27ef-012f-428d-ac2e-94550e0a7968 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:15.152874 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b7d27ef-012f-428d-ac2e-94550e0a7968 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:15.153765 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b7d27ef-012f-428d-ac2e-94550e0a7968 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:15.190692 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e0998f66-4acb-4aeb-b700-1d1122281cd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:15.201181 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e0998f66-4acb-4aeb-b700-1d1122281cd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1546 microversion: 2.1 time: 0.362468 Aug 26 11:07:15.206229 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 155/329] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:14 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1546 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:15.226361 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-2bcb34f8-cda6-4cb5-a36a-2707305737d5 req-e50c169f-950b-4759-a33f-cfa11980c1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304b1637-de58-42d2-8ae1-603821c8c782", "name": "network-vif-plugged", "status": "completed", "tag": "f30b2e93-d49f-40da-8153-b3c851cc68b4"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:15.259180 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-2bcb34f8-cda6-4cb5-a36a-2707305737d5 req-e50c169f-950b-4759-a33f-cfa11980c1e7 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:15.259641 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-2bcb34f8-cda6-4cb5-a36a-2707305737d5 req-e50c169f-950b-4759-a33f-cfa11980c1e7 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:15.260074 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-2bcb34f8-cda6-4cb5-a36a-2707305737d5 req-e50c169f-950b-4759-a33f-cfa11980c1e7 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:15.295509 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-2bcb34f8-cda6-4cb5-a36a-2707305737d5 req-e50c169f-950b-4759-a33f-cfa11980c1e7 service nova] Creating event network-vif-plugged:f30b2e93-d49f-40da-8153-b3c851cc68b4 for instance 304b1637-de58-42d2-8ae1-603821c8c782 on hv-cinder-85236 Aug 26 11:07:15.309922 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-2bcb34f8-cda6-4cb5-a36a-2707305737d5 req-e50c169f-950b-4759-a33f-cfa11980c1e7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101984 Aug 26 11:07:15.310579 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 156/330] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:07:15.320208 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b596aae3-a283-43a0-b6e9-b21ecccd69b9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:15.321159 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b596aae3-a283-43a0-b6e9-b21ecccd69b9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:15.330619 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b596aae3-a283-43a0-b6e9-b21ecccd69b9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:15.331485 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b596aae3-a283-43a0-b6e9-b21ecccd69b9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:15.332093 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b596aae3-a283-43a0-b6e9-b21ecccd69b9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:15.334753 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b596aae3-a283-43a0-b6e9-b21ecccd69b9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:15.335388 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b596aae3-a283-43a0-b6e9-b21ecccd69b9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:15.336448 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b596aae3-a283-43a0-b6e9-b21ecccd69b9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:15.519126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9b7d27ef-012f-428d-ac2e-94550e0a7968 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:15.532994 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-9b7d27ef-012f-428d-ac2e-94550e0a7968 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1315 microversion: 2.1 time: 0.412675 Aug 26 11:07:15.533855 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 175/331] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:15 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:15.589381 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b596aae3-a283-43a0-b6e9-b21ecccd69b9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:15.597415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b596aae3-a283-43a0-b6e9-b21ecccd69b9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1546 microversion: 2.1 time: 0.285523 Aug 26 11:07:15.597992 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 157/332] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:15 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1546 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:15.620032 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-ae6e5586-1238-4df7-8034-5b6308d7f3a2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:15.625634 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-ae6e5586-1238-4df7-8034-5b6308d7f3a2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:15.627184 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-ae6e5586-1238-4df7-8034-5b6308d7f3a2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Searching by: {'deleted': False, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12'} {{(pid=120605) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 26 11:07:15.641939 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ae6e5586-1238-4df7-8034-5b6308d7f3a2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:15.642712 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ae6e5586-1238-4df7-8034-5b6308d7f3a2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:15.643327 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ae6e5586-1238-4df7-8034-5b6308d7f3a2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:15.646923 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ae6e5586-1238-4df7-8034-5b6308d7f3a2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:15.647407 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ae6e5586-1238-4df7-8034-5b6308d7f3a2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:15.647847 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ae6e5586-1238-4df7-8034-5b6308d7f3a2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:15.774810 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-382356f0-326c-43e5-a4e2-fec42790b788 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:15.779974 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.multi_cell_list [None req-ae6e5586-1238-4df7-8034-5b6308d7f3a2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 26 11:07:15.787686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-382356f0-326c-43e5-a4e2-fec42790b788 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:15.788774 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-382356f0-326c-43e5-a4e2-fec42790b788 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:15.789418 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-382356f0-326c-43e5-a4e2-fec42790b788 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:15.878775 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-382356f0-326c-43e5-a4e2-fec42790b788 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Going to try to stop instance {{(pid=120604) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 26 11:07:15.892919 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-ae6e5586-1238-4df7-8034-5b6308d7f3a2 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.277094 Aug 26 11:07:15.894127 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 176/333] 10.222.0.40 () {58 vars in 1125 bytes} [Fri Aug 26 11:07:15 2022] GET /compute/v2.1/servers => generated 342 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:07:15.907656 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-baadc697-36bc-4097-9896-75c62701e9b3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:15.908266 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-baadc697-36bc-4097-9896-75c62701e9b3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:15.918187 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-baadc697-36bc-4097-9896-75c62701e9b3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:15.919046 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-baadc697-36bc-4097-9896-75c62701e9b3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:15.919698 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-baadc697-36bc-4097-9896-75c62701e9b3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:15.920610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-baadc697-36bc-4097-9896-75c62701e9b3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:15.921232 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-baadc697-36bc-4097-9896-75c62701e9b3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:15.921840 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-baadc697-36bc-4097-9896-75c62701e9b3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:15.944321 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-382356f0-326c-43e5-a4e2-fec42790b788 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "POST /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.173176 Aug 26 11:07:15.944928 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 158/334] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 11:07:15 2022] POST /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 11:07:15.972441 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9ae0b211-f11f-4423-9b0e-841b5dc1865c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:15.975222 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9ae0b211-f11f-4423-9b0e-841b5dc1865c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:15.986141 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ae0b211-f11f-4423-9b0e-841b5dc1865c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:15.986759 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ae0b211-f11f-4423-9b0e-841b5dc1865c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:15.987289 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ae0b211-f11f-4423-9b0e-841b5dc1865c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:15.988231 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ae0b211-f11f-4423-9b0e-841b5dc1865c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:15.989583 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ae0b211-f11f-4423-9b0e-841b5dc1865c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:15.990367 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ae0b211-f11f-4423-9b0e-841b5dc1865c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:16.147434 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-baadc697-36bc-4097-9896-75c62701e9b3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:16.156507 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-baadc697-36bc-4097-9896-75c62701e9b3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1546 microversion: 2.1 time: 0.253385 Aug 26 11:07:16.172157 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 177/335] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:15 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1546 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:16.179246 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-da6d50f1-d34c-4764-bc8b-1e0cc93378a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:16.179998 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-da6d50f1-d34c-4764-bc8b-1e0cc93378a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:16.187682 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-da6d50f1-d34c-4764-bc8b-1e0cc93378a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:16.188505 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-da6d50f1-d34c-4764-bc8b-1e0cc93378a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:16.189402 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-da6d50f1-d34c-4764-bc8b-1e0cc93378a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:16.190357 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-da6d50f1-d34c-4764-bc8b-1e0cc93378a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:16.190894 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-da6d50f1-d34c-4764-bc8b-1e0cc93378a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:16.191393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-da6d50f1-d34c-4764-bc8b-1e0cc93378a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:16.202023 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9ae0b211-f11f-4423-9b0e-841b5dc1865c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:16.216345 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9ae0b211-f11f-4423-9b0e-841b5dc1865c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.256172 Aug 26 11:07:16.233283 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 159/336] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:15 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:16.399250 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-da6d50f1-d34c-4764-bc8b-1e0cc93378a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:16.407738 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-da6d50f1-d34c-4764-bc8b-1e0cc93378a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:16.409646 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-da6d50f1-d34c-4764-bc8b-1e0cc93378a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:16.411562 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-da6d50f1-d34c-4764-bc8b-1e0cc93378a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1741 microversion: 2.20 time: 0.242937 Aug 26 11:07:16.412082 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 178/337] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:16 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1741 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:16.558639 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6f5f1c4e-50d6-4e28-9019-fa7c52e34895 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:16.559172 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6f5f1c4e-50d6-4e28-9019-fa7c52e34895 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:16.578321 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6f5f1c4e-50d6-4e28-9019-fa7c52e34895 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:16.578823 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6f5f1c4e-50d6-4e28-9019-fa7c52e34895 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:16.579270 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6f5f1c4e-50d6-4e28-9019-fa7c52e34895 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:16.579994 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6f5f1c4e-50d6-4e28-9019-fa7c52e34895 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:16.580446 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6f5f1c4e-50d6-4e28-9019-fa7c52e34895 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:16.580883 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6f5f1c4e-50d6-4e28-9019-fa7c52e34895 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:16.776031 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6f5f1c4e-50d6-4e28-9019-fa7c52e34895 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:16.786575 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:16.792495 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6f5f1c4e-50d6-4e28-9019-fa7c52e34895 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1315 microversion: 2.1 time: 0.236979 Aug 26 11:07:16.792495 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 160/338] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:16 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:17.245277 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-9febb7db-5bb1-4feb-8351-d15e0043a06f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:17.247568 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9febb7db-5bb1-4feb-8351-d15e0043a06f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:17.262501 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9febb7db-5bb1-4feb-8351-d15e0043a06f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:17.264982 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9febb7db-5bb1-4feb-8351-d15e0043a06f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:17.266345 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9febb7db-5bb1-4feb-8351-d15e0043a06f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:17.267967 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9febb7db-5bb1-4feb-8351-d15e0043a06f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:17.268901 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9febb7db-5bb1-4feb-8351-d15e0043a06f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:17.269749 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9febb7db-5bb1-4feb-8351-d15e0043a06f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:17.444111 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a1e3eec7-ffc6-47ab-8129-fef03f7924a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:17.445407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a1e3eec7-ffc6-47ab-8129-fef03f7924a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:17.460442 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a1e3eec7-ffc6-47ab-8129-fef03f7924a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:17.464773 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a1e3eec7-ffc6-47ab-8129-fef03f7924a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:17.465397 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a1e3eec7-ffc6-47ab-8129-fef03f7924a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:17.466268 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a1e3eec7-ffc6-47ab-8129-fef03f7924a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:17.466910 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a1e3eec7-ffc6-47ab-8129-fef03f7924a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:17.467407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a1e3eec7-ffc6-47ab-8129-fef03f7924a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:17.496857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9febb7db-5bb1-4feb-8351-d15e0043a06f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:17.508778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-9febb7db-5bb1-4feb-8351-d15e0043a06f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.273366 Aug 26 11:07:17.511802 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 179/339] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:17 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:17.651741 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a1e3eec7-ffc6-47ab-8129-fef03f7924a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:17.676774 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a1e3eec7-ffc6-47ab-8129-fef03f7924a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:17.679415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a1e3eec7-ffc6-47ab-8129-fef03f7924a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:17.682017 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a1e3eec7-ffc6-47ab-8129-fef03f7924a5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1741 microversion: 2.20 time: 0.243206 Aug 26 11:07:17.682017 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 161/340] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:17 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1741 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:07:17.819113 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-2f3fb2d2-c63d-4a42-8541-f50978597088 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:17.819826 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-2f3fb2d2-c63d-4a42-8541-f50978597088 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:17.833765 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2f3fb2d2-c63d-4a42-8541-f50978597088 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:17.834149 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2f3fb2d2-c63d-4a42-8541-f50978597088 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:17.837107 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2f3fb2d2-c63d-4a42-8541-f50978597088 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:17.838070 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2f3fb2d2-c63d-4a42-8541-f50978597088 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:17.838695 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2f3fb2d2-c63d-4a42-8541-f50978597088 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:17.839154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2f3fb2d2-c63d-4a42-8541-f50978597088 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:18.006422 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-fd04a55b-92d4-417f-8130-efd0a1c8472b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74cd7644-d6d9-4677-afdc-f779f29fa6c8"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:18.009545 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-fd04a55b-92d4-417f-8130-efd0a1c8472b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:18.016211 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fd04a55b-92d4-417f-8130-efd0a1c8472b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:18.016929 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fd04a55b-92d4-417f-8130-efd0a1c8472b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:18.017513 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fd04a55b-92d4-417f-8130-efd0a1c8472b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:18.018855 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fd04a55b-92d4-417f-8130-efd0a1c8472b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:18.019466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fd04a55b-92d4-417f-8130-efd0a1c8472b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:18.020511 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fd04a55b-92d4-417f-8130-efd0a1c8472b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:18.054535 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-2f3fb2d2-c63d-4a42-8541-f50978597088 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:18.064234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-2f3fb2d2-c63d-4a42-8541-f50978597088 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1464 microversion: 2.1 time: 0.249211 Aug 26 11:07:18.065452 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 180/341] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:17 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1464 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:18.124953 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-468b2fd6-2b52-465e-be41-570135f63489 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:18.125469 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-468b2fd6-2b52-465e-be41-570135f63489 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:18.134931 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-468b2fd6-2b52-465e-be41-570135f63489 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:18.135656 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-468b2fd6-2b52-465e-be41-570135f63489 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:18.136231 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-468b2fd6-2b52-465e-be41-570135f63489 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:18.137823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-468b2fd6-2b52-465e-be41-570135f63489 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:18.138144 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-468b2fd6-2b52-465e-be41-570135f63489 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:18.138582 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-468b2fd6-2b52-465e-be41-570135f63489 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:18.182272 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-468b2fd6-2b52-465e-be41-570135f63489 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Going to try to terminate instance {{(pid=120605) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:07:18.336129 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-468b2fd6-2b52-465e-be41-570135f63489 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "DELETE /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 204 len: 0 microversion: 2.1 time: 0.219338 Aug 26 11:07:18.337061 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 181/342] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:07:18 2022] DELETE /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:07:18.348885 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-db13e3e1-5d7a-4e61-9bfb-570524476ea1 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:18.349923 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-db13e3e1-5d7a-4e61-9bfb-570524476ea1 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:18.357373 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db13e3e1-5d7a-4e61-9bfb-570524476ea1 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:18.358061 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db13e3e1-5d7a-4e61-9bfb-570524476ea1 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:18.358652 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db13e3e1-5d7a-4e61-9bfb-570524476ea1 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:18.359540 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db13e3e1-5d7a-4e61-9bfb-570524476ea1 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:18.360170 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db13e3e1-5d7a-4e61-9bfb-570524476ea1 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:18.360667 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db13e3e1-5d7a-4e61-9bfb-570524476ea1 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:18.422689 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-fd04a55b-92d4-417f-8130-efd0a1c8472b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "POST /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421067 Aug 26 11:07:18.427663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 162/343] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 11:07:18 2022] POST /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:07:18.531836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8ed376de-682c-4049-921f-317ec013df14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:18.532586 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8ed376de-682c-4049-921f-317ec013df14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:18.543125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ed376de-682c-4049-921f-317ec013df14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:18.544023 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ed376de-682c-4049-921f-317ec013df14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:18.544746 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ed376de-682c-4049-921f-317ec013df14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:18.545715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ed376de-682c-4049-921f-317ec013df14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:18.546523 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ed376de-682c-4049-921f-317ec013df14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:18.547182 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ed376de-682c-4049-921f-317ec013df14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:18.608445 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-db13e3e1-5d7a-4e61-9bfb-570524476ea1 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:18.626510 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-db13e3e1-5d7a-4e61-9bfb-570524476ea1 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1470 microversion: 2.1 time: 0.284359 Aug 26 11:07:18.642018 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 182/344] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:18 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1470 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:18.715425 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4bceb5f6-deff-4b39-a982-bed5a8ab0a87 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:18.716095 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4bceb5f6-deff-4b39-a982-bed5a8ab0a87 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:18.729322 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4bceb5f6-deff-4b39-a982-bed5a8ab0a87 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:18.730077 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4bceb5f6-deff-4b39-a982-bed5a8ab0a87 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:18.730551 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4bceb5f6-deff-4b39-a982-bed5a8ab0a87 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:18.733812 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4bceb5f6-deff-4b39-a982-bed5a8ab0a87 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:18.734313 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4bceb5f6-deff-4b39-a982-bed5a8ab0a87 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:18.734774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4bceb5f6-deff-4b39-a982-bed5a8ab0a87 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:18.739768 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8ed376de-682c-4049-921f-317ec013df14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:18.753442 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8ed376de-682c-4049-921f-317ec013df14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.226713 Aug 26 11:07:18.755002 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 163/345] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:18 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:18.954924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4bceb5f6-deff-4b39-a982-bed5a8ab0a87 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:18.962114 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4bceb5f6-deff-4b39-a982-bed5a8ab0a87 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:18.963756 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4bceb5f6-deff-4b39-a982-bed5a8ab0a87 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:18.964770 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4bceb5f6-deff-4b39-a982-bed5a8ab0a87 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1741 microversion: 2.20 time: 0.254570 Aug 26 11:07:18.982647 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 183/346] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:18 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1741 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:07:19.655107 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d0e90dac-b3aa-4b91-88b6-789ca664cdca tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:19.655891 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d0e90dac-b3aa-4b91-88b6-789ca664cdca tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:19.673502 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0e90dac-b3aa-4b91-88b6-789ca664cdca tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:19.674019 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0e90dac-b3aa-4b91-88b6-789ca664cdca tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:19.674453 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0e90dac-b3aa-4b91-88b6-789ca664cdca tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:19.675313 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0e90dac-b3aa-4b91-88b6-789ca664cdca tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:19.675710 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0e90dac-b3aa-4b91-88b6-789ca664cdca tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:19.676068 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d0e90dac-b3aa-4b91-88b6-789ca664cdca tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:19.776825 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-bf54a3c4-5ec8-449d-ba54-d7fcc04764c3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:19.777941 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-bf54a3c4-5ec8-449d-ba54-d7fcc04764c3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:19.793499 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bf54a3c4-5ec8-449d-ba54-d7fcc04764c3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:19.796944 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bf54a3c4-5ec8-449d-ba54-d7fcc04764c3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:19.797499 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bf54a3c4-5ec8-449d-ba54-d7fcc04764c3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:19.798546 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bf54a3c4-5ec8-449d-ba54-d7fcc04764c3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:19.799898 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bf54a3c4-5ec8-449d-ba54-d7fcc04764c3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:19.800527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bf54a3c4-5ec8-449d-ba54-d7fcc04764c3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:19.950759 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d0e90dac-b3aa-4b91-88b6-789ca664cdca tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:19.966279 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d0e90dac-b3aa-4b91-88b6-789ca664cdca tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1470 microversion: 2.1 time: 0.317602 Aug 26 11:07:19.967564 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 164/347] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:19 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1470 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:19.988844 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-64760b57-86c8-4585-8a63-be1e6a9ef969 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:19.990097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-64760b57-86c8-4585-8a63-be1e6a9ef969 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:19.997879 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-64760b57-86c8-4585-8a63-be1e6a9ef969 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:19.998696 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-64760b57-86c8-4585-8a63-be1e6a9ef969 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:19.999310 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-64760b57-86c8-4585-8a63-be1e6a9ef969 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:20.000173 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-64760b57-86c8-4585-8a63-be1e6a9ef969 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:20.000810 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-64760b57-86c8-4585-8a63-be1e6a9ef969 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:20.001381 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-64760b57-86c8-4585-8a63-be1e6a9ef969 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:20.105806 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-bf54a3c4-5ec8-449d-ba54-d7fcc04764c3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:20.108960 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:20.121182 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-bf54a3c4-5ec8-449d-ba54-d7fcc04764c3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.348728 Aug 26 11:07:20.139621 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 184/348] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:19 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:20.272176 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-64760b57-86c8-4585-8a63-be1e6a9ef969 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:20.282893 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-64760b57-86c8-4585-8a63-be1e6a9ef969 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:20.284370 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-64760b57-86c8-4585-8a63-be1e6a9ef969 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:20.286296 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-64760b57-86c8-4585-8a63-be1e6a9ef969 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1741 microversion: 2.20 time: 0.301165 Aug 26 11:07:20.287167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 165/349] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:19 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1741 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:20.936822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-501c0cb9-7ea8-47d2-85ca-020c3c1dccb6 req-1b21235c-13df-48e5-b291-8463cfdfe594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304b1637-de58-42d2-8ae1-603821c8c782", "name": "network-vif-deleted", "tag": "f30b2e93-d49f-40da-8153-b3c851cc68b4"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:20.952940 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-501c0cb9-7ea8-47d2-85ca-020c3c1dccb6 req-1b21235c-13df-48e5-b291-8463cfdfe594 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:20.959601 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-501c0cb9-7ea8-47d2-85ca-020c3c1dccb6 req-1b21235c-13df-48e5-b291-8463cfdfe594 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:20.961090 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-501c0cb9-7ea8-47d2-85ca-020c3c1dccb6 req-1b21235c-13df-48e5-b291-8463cfdfe594 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:20.991921 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ac894fb5-f2a2-4b07-9d1a-617e05fd7f72 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:20.993125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ac894fb5-f2a2-4b07-9d1a-617e05fd7f72 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:20.998667 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-501c0cb9-7ea8-47d2-85ca-020c3c1dccb6 req-1b21235c-13df-48e5-b291-8463cfdfe594 service nova] Creating event network-vif-deleted:f30b2e93-d49f-40da-8153-b3c851cc68b4 for instance 304b1637-de58-42d2-8ae1-603821c8c782 on hv-cinder-85236 Aug 26 11:07:21.002077 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac894fb5-f2a2-4b07-9d1a-617e05fd7f72 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:21.011361 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac894fb5-f2a2-4b07-9d1a-617e05fd7f72 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:21.012071 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac894fb5-f2a2-4b07-9d1a-617e05fd7f72 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:21.014971 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac894fb5-f2a2-4b07-9d1a-617e05fd7f72 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:21.015692 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac894fb5-f2a2-4b07-9d1a-617e05fd7f72 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:21.016326 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac894fb5-f2a2-4b07-9d1a-617e05fd7f72 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:21.016813 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-501c0cb9-7ea8-47d2-85ca-020c3c1dccb6 req-1b21235c-13df-48e5-b291-8463cfdfe594 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083943 Aug 26 11:07:21.021025 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 185/350] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:07:21.107639 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ac894fb5-f2a2-4b07-9d1a-617e05fd7f72 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275df87a6e384102be2194b74b180358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b87c51628c342cfa953a7110735d469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:21.116916 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ac894fb5-f2a2-4b07-9d1a-617e05fd7f72 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 200 len: 1300 microversion: 2.1 time: 0.132023 Aug 26 11:07:21.118618 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 166/351] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:20 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 1300 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:21.147056 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-9fb8788f-ff32-474b-8a04-50ecb6ce60d1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:21.148413 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9fb8788f-ff32-474b-8a04-50ecb6ce60d1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:21.158466 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9fb8788f-ff32-474b-8a04-50ecb6ce60d1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:21.159278 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9fb8788f-ff32-474b-8a04-50ecb6ce60d1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:21.159784 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9fb8788f-ff32-474b-8a04-50ecb6ce60d1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:21.161120 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9fb8788f-ff32-474b-8a04-50ecb6ce60d1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:21.161808 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9fb8788f-ff32-474b-8a04-50ecb6ce60d1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:21.162442 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9fb8788f-ff32-474b-8a04-50ecb6ce60d1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:21.312786 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-77a36261-ee15-4cb3-80e8-34afb488c6f3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:21.313806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-77a36261-ee15-4cb3-80e8-34afb488c6f3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:21.334886 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9fb8788f-ff32-474b-8a04-50ecb6ce60d1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:21.340678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-77a36261-ee15-4cb3-80e8-34afb488c6f3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:21.341744 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-77a36261-ee15-4cb3-80e8-34afb488c6f3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:21.343155 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-77a36261-ee15-4cb3-80e8-34afb488c6f3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:21.344508 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-77a36261-ee15-4cb3-80e8-34afb488c6f3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:21.345446 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-77a36261-ee15-4cb3-80e8-34afb488c6f3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:21.345808 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-9fb8788f-ff32-474b-8a04-50ecb6ce60d1 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.203432 Aug 26 11:07:21.345953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-77a36261-ee15-4cb3-80e8-34afb488c6f3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:21.358411 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 186/352] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:21 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:21.509786 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-77a36261-ee15-4cb3-80e8-34afb488c6f3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:21.518854 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-77a36261-ee15-4cb3-80e8-34afb488c6f3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:21.521058 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-77a36261-ee15-4cb3-80e8-34afb488c6f3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:21.522625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-77a36261-ee15-4cb3-80e8-34afb488c6f3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1741 microversion: 2.20 time: 0.215937 Aug 26 11:07:21.523566 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 167/353] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:21 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1741 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:22.138739 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a11540c0-237c-47b8-b002-0cfde77c06f4 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:22.140902 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-a11540c0-237c-47b8-b002-0cfde77c06f4 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] [instance: 304b1637-de58-42d2-8ae1-603821c8c782] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:22.148514 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a11540c0-237c-47b8-b002-0cfde77c06f4 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:22.149059 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a11540c0-237c-47b8-b002-0cfde77c06f4 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:22.149494 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a11540c0-237c-47b8-b002-0cfde77c06f4 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:22.150428 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a11540c0-237c-47b8-b002-0cfde77c06f4 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:22.150883 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a11540c0-237c-47b8-b002-0cfde77c06f4 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:22.151306 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a11540c0-237c-47b8-b002-0cfde77c06f4 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:22.166955 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-a11540c0-237c-47b8-b002-0cfde77c06f4 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] HTTP exception thrown: Instance 304b1637-de58-42d2-8ae1-603821c8c782 could not be found. Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a11540c0-237c-47b8-b002-0cfde77c06f4 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Request method failure captured: Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 HTTP/1.1 Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKlJZ6JF3JfV5SoYSkGpg0m08ypHjAndstYKcqSBvY18WoqbFdV9Izh4FtKw5xfxAx-hQk3ZWA_HSriqtyVqNm33LjJ1zAIz2TdCAO7vNh5k2MwNOH0a4TFL6N0BosU_H-cPWEGHitV3E9gV8rSngj6JRi5ED0lHKblX5HuAQZforDs Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: 1b87c51628c342cfa953a7110735d469 Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-VolumesNegativeTest-2018872669 Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:07:22.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:07:22.170392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1b87c51628c342cfa953a7110735d469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1b87c51628c342cfa953a7110735d469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b87c51628c342cfa953a7110735d469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b87c51628c342cfa953a7110735d469"}]}] Aug 26 11:07:22.170392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-VolumesNegativeTest-2018872669 Aug 26 11:07:22.170392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: 1b87c51628c342cfa953a7110735d469 Aug 26 11:07:22.170392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-VolumesNegativeTest-2018872669 Aug 26 11:07:22.170392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-VolumesNegativeTest-2018872669-project Aug 26 11:07:22.170392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:07:22.170392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:07:22.170392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: 275df87a6e384102be2194b74b180358 Aug 26 11:07:22.170392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-VolumesNegativeTest-2018872669-project Aug 26 11:07:22.170392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:07:22.170392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance 304b1637-de58-42d2-8ae1-603821c8c782 could not be found. Aug 26 11:07:22.170392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': '304b1637-de58-42d2-8ae1-603821c8c782'} Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 304b1637-de58-42d2-8ae1-603821c8c782 could not be found. Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:07:22.171176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 304b1637-de58-42d2-8ae1-603821c8c782 could not be found. Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 304b1637-de58-42d2-8ae1-603821c8c782 could not be found. Aug 26 11:07:22.172358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:07:22.173400 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a11540c0-237c-47b8-b002-0cfde77c06f4 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] Returning 404 to user: Instance 304b1637-de58-42d2-8ae1-603821c8c782 could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:07:22.173400 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-a11540c0-237c-47b8-b002-0cfde77c06f4 tempest-VolumesNegativeTest-2018872669 tempest-VolumesNegativeTest-2018872669-project] 10.222.0.40 "GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782" status: 404 len: 111 microversion: 2.1 time: 0.035417 Aug 26 11:07:22.179453 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 187/354] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:22 2022] GET /compute/v2.1/servers/304b1637-de58-42d2-8ae1-603821c8c782 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:07:22.370377 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7a770f8f-4d53-4075-a6fd-a3d685e0ad2f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:22.370919 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7a770f8f-4d53-4075-a6fd-a3d685e0ad2f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:22.377557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7a770f8f-4d53-4075-a6fd-a3d685e0ad2f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:22.378023 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7a770f8f-4d53-4075-a6fd-a3d685e0ad2f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:22.378660 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7a770f8f-4d53-4075-a6fd-a3d685e0ad2f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:22.381162 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7a770f8f-4d53-4075-a6fd-a3d685e0ad2f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:22.381653 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7a770f8f-4d53-4075-a6fd-a3d685e0ad2f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:22.382118 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7a770f8f-4d53-4075-a6fd-a3d685e0ad2f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:22.537114 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7a770f8f-4d53-4075-a6fd-a3d685e0ad2f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:22.546563 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7a770f8f-4d53-4075-a6fd-a3d685e0ad2f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.180840 Aug 26 11:07:22.547380 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 168/355] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:22 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:22.548257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4a99dc2b-b8cf-431f-aa7c-837c4c439797 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:22.548930 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4a99dc2b-b8cf-431f-aa7c-837c4c439797 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:22.555063 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4a99dc2b-b8cf-431f-aa7c-837c4c439797 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:22.555618 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4a99dc2b-b8cf-431f-aa7c-837c4c439797 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:22.556092 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4a99dc2b-b8cf-431f-aa7c-837c4c439797 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:22.556966 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4a99dc2b-b8cf-431f-aa7c-837c4c439797 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:22.557403 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4a99dc2b-b8cf-431f-aa7c-837c4c439797 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:22.557820 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4a99dc2b-b8cf-431f-aa7c-837c4c439797 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:22.693075 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4a99dc2b-b8cf-431f-aa7c-837c4c439797 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:22.701191 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4a99dc2b-b8cf-431f-aa7c-837c4c439797 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:22.702659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4a99dc2b-b8cf-431f-aa7c-837c4c439797 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:22.703801 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4a99dc2b-b8cf-431f-aa7c-837c4c439797 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1741 microversion: 2.20 time: 0.160418 Aug 26 11:07:22.704349 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 188/356] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:22 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:07:23.569301 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9f05b4ea-3c75-4ded-84d9-bd580c5307ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:23.570909 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9f05b4ea-3c75-4ded-84d9-bd580c5307ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:23.577470 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f05b4ea-3c75-4ded-84d9-bd580c5307ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:23.578186 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f05b4ea-3c75-4ded-84d9-bd580c5307ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:23.578623 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f05b4ea-3c75-4ded-84d9-bd580c5307ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:23.579323 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f05b4ea-3c75-4ded-84d9-bd580c5307ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:23.579773 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f05b4ea-3c75-4ded-84d9-bd580c5307ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:23.580188 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f05b4ea-3c75-4ded-84d9-bd580c5307ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:23.732612 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a002ab80-70e8-4a1f-b7e6-90594b91f3ee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:23.735414 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-a002ab80-70e8-4a1f-b7e6-90594b91f3ee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:23.741317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9f05b4ea-3c75-4ded-84d9-bd580c5307ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:23.743938 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a002ab80-70e8-4a1f-b7e6-90594b91f3ee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:23.745247 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a002ab80-70e8-4a1f-b7e6-90594b91f3ee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:23.745696 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a002ab80-70e8-4a1f-b7e6-90594b91f3ee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:23.746737 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a002ab80-70e8-4a1f-b7e6-90594b91f3ee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:23.747570 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a002ab80-70e8-4a1f-b7e6-90594b91f3ee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:23.748144 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a002ab80-70e8-4a1f-b7e6-90594b91f3ee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:23.750313 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9f05b4ea-3c75-4ded-84d9-bd580c5307ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.186014 Aug 26 11:07:23.750883 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 169/357] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:23 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:23.903141 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-a002ab80-70e8-4a1f-b7e6-90594b91f3ee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:23.911329 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-a002ab80-70e8-4a1f-b7e6-90594b91f3ee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:23.912802 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-a002ab80-70e8-4a1f-b7e6-90594b91f3ee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:23.913969 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-a002ab80-70e8-4a1f-b7e6-90594b91f3ee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1723 microversion: 2.20 time: 0.191126 Aug 26 11:07:23.914552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 189/358] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:23 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:24.775834 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-105a2ede-c366-4316-90b1-1f68f4b47e35 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:24.776451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-105a2ede-c366-4316-90b1-1f68f4b47e35 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:24.783046 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-105a2ede-c366-4316-90b1-1f68f4b47e35 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:24.783664 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-105a2ede-c366-4316-90b1-1f68f4b47e35 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:24.784300 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-105a2ede-c366-4316-90b1-1f68f4b47e35 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:24.784943 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-105a2ede-c366-4316-90b1-1f68f4b47e35 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:24.785474 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-105a2ede-c366-4316-90b1-1f68f4b47e35 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:24.786490 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-105a2ede-c366-4316-90b1-1f68f4b47e35 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:24.937989 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-34767205-00bf-4033-98cf-c62827406b97 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:24.938613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-34767205-00bf-4033-98cf-c62827406b97 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:24.938898 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-105a2ede-c366-4316-90b1-1f68f4b47e35 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:24.946261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-34767205-00bf-4033-98cf-c62827406b97 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:24.946756 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-34767205-00bf-4033-98cf-c62827406b97 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:24.947190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-34767205-00bf-4033-98cf-c62827406b97 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:24.947892 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-34767205-00bf-4033-98cf-c62827406b97 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:24.948338 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-34767205-00bf-4033-98cf-c62827406b97 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:24.948928 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-34767205-00bf-4033-98cf-c62827406b97 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:24.951302 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-105a2ede-c366-4316-90b1-1f68f4b47e35 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.179263 Aug 26 11:07:24.952207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 170/359] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:24 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:25.091860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-34767205-00bf-4033-98cf-c62827406b97 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:25.102593 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-34767205-00bf-4033-98cf-c62827406b97 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:25.104079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-34767205-00bf-4033-98cf-c62827406b97 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:25.105323 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-34767205-00bf-4033-98cf-c62827406b97 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1723 microversion: 2.20 time: 0.171268 Aug 26 11:07:25.105911 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 190/360] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:24 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:07:25.973870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b19d1171-16b5-4861-8e9e-c92e44569807 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:25.974397 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b19d1171-16b5-4861-8e9e-c92e44569807 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:25.981133 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b19d1171-16b5-4861-8e9e-c92e44569807 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:25.981626 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b19d1171-16b5-4861-8e9e-c92e44569807 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:25.982876 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b19d1171-16b5-4861-8e9e-c92e44569807 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:25.983762 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b19d1171-16b5-4861-8e9e-c92e44569807 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:25.984276 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b19d1171-16b5-4861-8e9e-c92e44569807 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:25.984709 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b19d1171-16b5-4861-8e9e-c92e44569807 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:26.128994 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b19d1171-16b5-4861-8e9e-c92e44569807 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:26.132089 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-29865459-4458-44ff-9a03-601edd58b55e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:26.132725 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-29865459-4458-44ff-9a03-601edd58b55e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:26.134808 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:26.138866 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b19d1171-16b5-4861-8e9e-c92e44569807 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.169517 Aug 26 11:07:26.139502 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 171/361] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:25 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:26.149218 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29865459-4458-44ff-9a03-601edd58b55e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:26.149218 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29865459-4458-44ff-9a03-601edd58b55e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:26.149218 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29865459-4458-44ff-9a03-601edd58b55e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:26.149218 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29865459-4458-44ff-9a03-601edd58b55e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:26.149868 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29865459-4458-44ff-9a03-601edd58b55e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:26.149868 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29865459-4458-44ff-9a03-601edd58b55e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:26.291130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-29865459-4458-44ff-9a03-601edd58b55e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:26.300790 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-29865459-4458-44ff-9a03-601edd58b55e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:26.302836 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-29865459-4458-44ff-9a03-601edd58b55e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:26.304018 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-29865459-4458-44ff-9a03-601edd58b55e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1723 microversion: 2.20 time: 0.177626 Aug 26 11:07:26.304771 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 191/362] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:26 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:26.822574 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-f51a4573-7b27-456a-a002-0dd68491d348 req-499d9dff-e210-42b6-9567-de2822475aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ae91d9-0521-4d14-b2b6-e56f249c4181", "name": "network-vif-unplugged", "status": "completed", "tag": "36a4faa3-3a22-4156-8542-c0c5ea7e7f1c"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:26.840300 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-f51a4573-7b27-456a-a002-0dd68491d348 req-499d9dff-e210-42b6-9567-de2822475aa3 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:26.841221 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-f51a4573-7b27-456a-a002-0dd68491d348 req-499d9dff-e210-42b6-9567-de2822475aa3 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:26.842433 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-f51a4573-7b27-456a-a002-0dd68491d348 req-499d9dff-e210-42b6-9567-de2822475aa3 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:26.864580 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-f51a4573-7b27-456a-a002-0dd68491d348 req-499d9dff-e210-42b6-9567-de2822475aa3 service nova] Creating event network-vif-unplugged:36a4faa3-3a22-4156-8542-c0c5ea7e7f1c for instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 on hv-cinder-85236 Aug 26 11:07:26.875728 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-f51a4573-7b27-456a-a002-0dd68491d348 req-499d9dff-e210-42b6-9567-de2822475aa3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060249 Aug 26 11:07:26.877776 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 172/363] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:07:27.162579 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-9af8cb79-884f-4cb4-89fb-694e1543f7df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:27.163523 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9af8cb79-884f-4cb4-89fb-694e1543f7df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:27.171669 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9af8cb79-884f-4cb4-89fb-694e1543f7df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:27.172384 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9af8cb79-884f-4cb4-89fb-694e1543f7df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:27.173239 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9af8cb79-884f-4cb4-89fb-694e1543f7df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:27.174138 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9af8cb79-884f-4cb4-89fb-694e1543f7df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:27.174729 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9af8cb79-884f-4cb4-89fb-694e1543f7df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:27.175247 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9af8cb79-884f-4cb4-89fb-694e1543f7df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:27.329255 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1a851082-05f0-4947-acfd-d42dc5bc00b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:27.330285 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1a851082-05f0-4947-acfd-d42dc5bc00b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:27.338309 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a851082-05f0-4947-acfd-d42dc5bc00b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:27.339094 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a851082-05f0-4947-acfd-d42dc5bc00b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:27.339688 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a851082-05f0-4947-acfd-d42dc5bc00b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:27.340944 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a851082-05f0-4947-acfd-d42dc5bc00b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:27.341797 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a851082-05f0-4947-acfd-d42dc5bc00b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:27.342618 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a851082-05f0-4947-acfd-d42dc5bc00b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:27.378575 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9af8cb79-884f-4cb4-89fb-694e1543f7df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:27.389607 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-9af8cb79-884f-4cb4-89fb-694e1543f7df tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.231176 Aug 26 11:07:27.390182 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 192/364] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:27 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:27.519294 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1a851082-05f0-4947-acfd-d42dc5bc00b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:27.530400 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1a851082-05f0-4947-acfd-d42dc5bc00b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:27.532232 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1a851082-05f0-4947-acfd-d42dc5bc00b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:27.533692 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1a851082-05f0-4947-acfd-d42dc5bc00b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1726 microversion: 2.20 time: 0.208735 Aug 26 11:07:27.534419 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 173/365] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:27 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1726 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:27.567335 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a9c71d55-9753-41bf-8b6a-3927d5add33b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70598002-b341-4079-a5f1-ee57cf444374"}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:27.570291 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-a9c71d55-9753-41bf-8b6a-3927d5add33b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:27.579691 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a9c71d55-9753-41bf-8b6a-3927d5add33b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:27.580545 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a9c71d55-9753-41bf-8b6a-3927d5add33b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:27.581133 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a9c71d55-9753-41bf-8b6a-3927d5add33b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:27.582063 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a9c71d55-9753-41bf-8b6a-3927d5add33b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:27.583346 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a9c71d55-9753-41bf-8b6a-3927d5add33b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:27.583847 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a9c71d55-9753-41bf-8b6a-3927d5add33b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:27.976559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-a9c71d55-9753-41bf-8b6a-3927d5add33b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "POST /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.414825 Aug 26 11:07:27.977312 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 193/366] 10.222.0.40 () {62 vars in 1364 bytes} [Fri Aug 26 11:07:27 2022] POST /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/os-volume_attachments => generated 188 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 11:07:28.122391 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9d2c937e-a7e2-4e11-b267-a60ea1596a5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:28.123622 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9d2c937e-a7e2-4e11-b267-a60ea1596a5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:28.132319 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d2c937e-a7e2-4e11-b267-a60ea1596a5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:28.132808 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d2c937e-a7e2-4e11-b267-a60ea1596a5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:28.133733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d2c937e-a7e2-4e11-b267-a60ea1596a5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:28.134506 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d2c937e-a7e2-4e11-b267-a60ea1596a5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:28.135054 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d2c937e-a7e2-4e11-b267-a60ea1596a5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:28.135487 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d2c937e-a7e2-4e11-b267-a60ea1596a5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:28.190215 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9d2c937e-a7e2-4e11-b267-a60ea1596a5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120604) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 11:07:28.299799 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9d2c937e-a7e2-4e11-b267-a60ea1596a5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "POST /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/action" status: 202 len: 0 microversion: 2.20 time: 0.184804 Aug 26 11:07:28.304345 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 174/367] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Aug 26 11:07:28 2022] POST /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:07:28.316318 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5e31a600-67aa-49db-8605-677f9df7fce5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:28.317766 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5e31a600-67aa-49db-8605-677f9df7fce5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:28.330839 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5e31a600-67aa-49db-8605-677f9df7fce5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:28.331346 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5e31a600-67aa-49db-8605-677f9df7fce5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:28.331783 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5e31a600-67aa-49db-8605-677f9df7fce5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:28.332565 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5e31a600-67aa-49db-8605-677f9df7fce5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:28.333055 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5e31a600-67aa-49db-8605-677f9df7fce5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:28.333612 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5e31a600-67aa-49db-8605-677f9df7fce5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:28.375313 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-cfffad7a-cefc-4b1a-8f07-521561259e93 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:28.377019 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-cfffad7a-cefc-4b1a-8f07-521561259e93 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:28.385032 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cfffad7a-cefc-4b1a-8f07-521561259e93 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:28.386323 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cfffad7a-cefc-4b1a-8f07-521561259e93 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:28.387110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cfffad7a-cefc-4b1a-8f07-521561259e93 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:28.388423 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cfffad7a-cefc-4b1a-8f07-521561259e93 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:28.389313 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cfffad7a-cefc-4b1a-8f07-521561259e93 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:28.390054 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cfffad7a-cefc-4b1a-8f07-521561259e93 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:28.691119 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5e31a600-67aa-49db-8605-677f9df7fce5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:28.710763 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5e31a600-67aa-49db-8605-677f9df7fce5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:28.712810 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5e31a600-67aa-49db-8605-677f9df7fce5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:28.714264 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5e31a600-67aa-49db-8605-677f9df7fce5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1752 microversion: 2.20 time: 0.405007 Aug 26 11:07:28.715066 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 194/368] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:28 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1752 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:28.720167 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0227f23e-99c1-40e9-924c-fddc70aafa73 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:28.721019 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0227f23e-99c1-40e9-924c-fddc70aafa73 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:28.727576 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0227f23e-99c1-40e9-924c-fddc70aafa73 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:28.728094 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0227f23e-99c1-40e9-924c-fddc70aafa73 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:28.728517 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0227f23e-99c1-40e9-924c-fddc70aafa73 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:28.729219 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0227f23e-99c1-40e9-924c-fddc70aafa73 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:28.729672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0227f23e-99c1-40e9-924c-fddc70aafa73 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:28.730129 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0227f23e-99c1-40e9-924c-fddc70aafa73 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:28.735224 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-cfffad7a-cefc-4b1a-8f07-521561259e93 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:28.742623 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:28.764481 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-cfffad7a-cefc-4b1a-8f07-521561259e93 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1592 microversion: 2.1 time: 0.395770 Aug 26 11:07:28.787670 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 175/369] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:28 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1592 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:28.944406 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0227f23e-99c1-40e9-924c-fddc70aafa73 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:28.955255 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0227f23e-99c1-40e9-924c-fddc70aafa73 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.238927 Aug 26 11:07:28.962040 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 195/370] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:28 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:29.746139 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-de67a875-6a9a-460d-bf1a-c5da1cccb9b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:29.747623 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-de67a875-6a9a-460d-bf1a-c5da1cccb9b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:29.763539 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de67a875-6a9a-460d-bf1a-c5da1cccb9b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:29.764409 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de67a875-6a9a-460d-bf1a-c5da1cccb9b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:29.764965 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de67a875-6a9a-460d-bf1a-c5da1cccb9b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:29.765714 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de67a875-6a9a-460d-bf1a-c5da1cccb9b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:29.766200 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de67a875-6a9a-460d-bf1a-c5da1cccb9b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:29.766632 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de67a875-6a9a-460d-bf1a-c5da1cccb9b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:29.981394 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-6fa446c1-2b92-49dd-9546-8c56dd6ee3fd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:29.982342 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-6fa446c1-2b92-49dd-9546-8c56dd6ee3fd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:29.990815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-de67a875-6a9a-460d-bf1a-c5da1cccb9b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:29.992957 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6fa446c1-2b92-49dd-9546-8c56dd6ee3fd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:29.996856 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6fa446c1-2b92-49dd-9546-8c56dd6ee3fd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:29.999934 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6fa446c1-2b92-49dd-9546-8c56dd6ee3fd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:30.001255 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6fa446c1-2b92-49dd-9546-8c56dd6ee3fd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:30.002645 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6fa446c1-2b92-49dd-9546-8c56dd6ee3fd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:30.005140 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6fa446c1-2b92-49dd-9546-8c56dd6ee3fd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:30.008048 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-de67a875-6a9a-460d-bf1a-c5da1cccb9b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:30.010518 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-de67a875-6a9a-460d-bf1a-c5da1cccb9b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:30.012601 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-de67a875-6a9a-460d-bf1a-c5da1cccb9b6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1752 microversion: 2.20 time: 0.270927 Aug 26 11:07:30.034133 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 176/371] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:29 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1752 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:30.161412 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6fa446c1-2b92-49dd-9546-8c56dd6ee3fd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:30.169798 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-6fa446c1-2b92-49dd-9546-8c56dd6ee3fd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.194219 Aug 26 11:07:30.170419 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 196/372] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:29 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:31.048139 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-83d1d371-7152-4593-a822-baa70a4a4c86 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:31.048813 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-83d1d371-7152-4593-a822-baa70a4a4c86 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:31.064711 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-83d1d371-7152-4593-a822-baa70a4a4c86 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:31.065278 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-83d1d371-7152-4593-a822-baa70a4a4c86 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:31.065939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-83d1d371-7152-4593-a822-baa70a4a4c86 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:31.067922 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-83d1d371-7152-4593-a822-baa70a4a4c86 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:31.068561 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-83d1d371-7152-4593-a822-baa70a4a4c86 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:31.072418 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-83d1d371-7152-4593-a822-baa70a4a4c86 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:31.080445 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1855128966", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452", "networks": [{"uuid": "e5e46ef0-dbf5-44da-8924-d19e9ec8988c"}]}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:31.159564 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.network.neutron [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] validate_networks() for [('e5e46ef0-dbf5-44da-8924-d19e9ec8988c', None, None, None, None, None)] {{(pid=120605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:07:31.408079 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-83d1d371-7152-4593-a822-baa70a4a4c86 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:31.425465 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-83d1d371-7152-4593-a822-baa70a4a4c86 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:31.429017 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-83d1d371-7152-4593-a822-baa70a4a4c86 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:31.443731 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-83d1d371-7152-4593-a822-baa70a4a4c86 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.389998 Aug 26 11:07:31.445169 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 177/373] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:31 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:07:31.452884 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-4acad5c1-0854-4f6e-8afe-3e9d70f9720c req-03b4a8d2-c8e8-4fea-bf65-3cf5d601be1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136f48c9-a521-4bc3-b6cc-98da91d02c49", "tag": "9431c858-ac93-4f2b-a673-fd8e539b68c8"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:31.468926 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-4acad5c1-0854-4f6e-8afe-3e9d70f9720c req-03b4a8d2-c8e8-4fea-bf65-3cf5d601be1c service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:31.469671 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-4acad5c1-0854-4f6e-8afe-3e9d70f9720c req-03b4a8d2-c8e8-4fea-bf65-3cf5d601be1c service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:31.470595 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-4acad5c1-0854-4f6e-8afe-3e9d70f9720c req-03b4a8d2-c8e8-4fea-bf65-3cf5d601be1c service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:31.500671 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-4acad5c1-0854-4f6e-8afe-3e9d70f9720c req-03b4a8d2-c8e8-4fea-bf65-3cf5d601be1c service nova] Creating event network-changed:9431c858-ac93-4f2b-a673-fd8e539b68c8 for instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 on hv-cinder-85236 Aug 26 11:07:31.515899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-4acad5c1-0854-4f6e-8afe-3e9d70f9720c req-03b4a8d2-c8e8-4fea-bf65-3cf5d601be1c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065295 Aug 26 11:07:31.516973 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 178/374] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:07:31.534308 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-71f7bb54-3cc9-40fe-a2b2-2b80a3754a38 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:31.539503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-71f7bb54-3cc9-40fe-a2b2-2b80a3754a38 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:31.554686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71f7bb54-3cc9-40fe-a2b2-2b80a3754a38 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:31.556121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71f7bb54-3cc9-40fe-a2b2-2b80a3754a38 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:31.556885 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71f7bb54-3cc9-40fe-a2b2-2b80a3754a38 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:31.558140 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71f7bb54-3cc9-40fe-a2b2-2b80a3754a38 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:31.559037 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71f7bb54-3cc9-40fe-a2b2-2b80a3754a38 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:31.560016 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71f7bb54-3cc9-40fe-a2b2-2b80a3754a38 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:31.876199 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Flavor limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:07:31.877015 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Image limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:07:31.877492 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Flavor pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:07:31.877666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-71f7bb54-3cc9-40fe-a2b2-2b80a3754a38 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:31.878443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Image pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:07:31.879919 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:07:31.889708 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-71f7bb54-3cc9-40fe-a2b2-2b80a3754a38 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.370683 Aug 26 11:07:31.891257 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 179/375] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:31 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:31.893138 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:31.893795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:31.894259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:31.895786 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:31.896439 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:31.896900 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:31.916340 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Getting quotas for project de754769f766487e859de1729e9d7a77. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:07:31.920974 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Getting quotas for user c3aaf776da3a4bb0853946c195112f40 and project de754769f766487e859de1729e9d7a77. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:07:31.937574 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Going to run 1 instances... {{(pid=120605) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:07:31.940645 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:07:31.963522 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:31.995461 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-13579bbf-7f99-40ca-8616-fce7ab909430 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920103 Aug 26 11:07:31.996891 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 197/376] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:07:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 11:07:32.011326 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-35210fe7-f58b-4cc8-8720-c21af59ec745 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:32.012316 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-35210fe7-f58b-4cc8-8720-c21af59ec745 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:32.080640 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-35210fe7-f58b-4cc8-8720-c21af59ec745 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:32.103580 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-35210fe7-f58b-4cc8-8720-c21af59ec745 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1219 microversion: 2.1 time: 0.097951 Aug 26 11:07:32.104493 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 180/377] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:32 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:32.472279 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-68418811-e661-4379-a658-75df21e45f7e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:32.473702 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-68418811-e661-4379-a658-75df21e45f7e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:32.482322 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-68418811-e661-4379-a658-75df21e45f7e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:32.483343 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-68418811-e661-4379-a658-75df21e45f7e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:32.483970 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-68418811-e661-4379-a658-75df21e45f7e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:32.485037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-68418811-e661-4379-a658-75df21e45f7e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:32.486640 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-68418811-e661-4379-a658-75df21e45f7e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:32.487266 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-68418811-e661-4379-a658-75df21e45f7e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:32.722385 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-68418811-e661-4379-a658-75df21e45f7e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:32.733580 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-68418811-e661-4379-a658-75df21e45f7e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:32.735518 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-68418811-e661-4379-a658-75df21e45f7e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:32.752033 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-68418811-e661-4379-a658-75df21e45f7e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.284135 Aug 26 11:07:32.755888 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 198/378] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:32 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:32.916704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4059f745-595f-4d49-bb56-7e904e48b6d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:32.917351 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4059f745-595f-4d49-bb56-7e904e48b6d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:32.926852 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4059f745-595f-4d49-bb56-7e904e48b6d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:32.930901 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4059f745-595f-4d49-bb56-7e904e48b6d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:32.932052 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4059f745-595f-4d49-bb56-7e904e48b6d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:32.933053 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4059f745-595f-4d49-bb56-7e904e48b6d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:32.933703 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4059f745-595f-4d49-bb56-7e904e48b6d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:32.934214 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4059f745-595f-4d49-bb56-7e904e48b6d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:33.139710 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f3725679-bc8c-43ce-821e-82907c5a08b3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:33.145931 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f3725679-bc8c-43ce-821e-82907c5a08b3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:33.164009 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f3725679-bc8c-43ce-821e-82907c5a08b3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:33.165630 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f3725679-bc8c-43ce-821e-82907c5a08b3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:33.170390 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f3725679-bc8c-43ce-821e-82907c5a08b3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:33.171430 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f3725679-bc8c-43ce-821e-82907c5a08b3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:33.172010 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f3725679-bc8c-43ce-821e-82907c5a08b3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:33.172559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f3725679-bc8c-43ce-821e-82907c5a08b3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:33.267043 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4059f745-595f-4d49-bb56-7e904e48b6d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:33.268296 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f3725679-bc8c-43ce-821e-82907c5a08b3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:33.277071 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f3725679-bc8c-43ce-821e-82907c5a08b3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1271 microversion: 2.1 time: 0.154178 Aug 26 11:07:33.278779 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4059f745-595f-4d49-bb56-7e904e48b6d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.364636 Aug 26 11:07:33.279628 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 181/379] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:32 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:33.286543 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 199/380] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:33 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:33.316913 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-fb1f2c75-c8dd-407e-a0d3-082a495fb563 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-640556961"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:33.317454 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-fb1f2c75-c8dd-407e-a0d3-082a495fb563 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:33.323437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fb1f2c75-c8dd-407e-a0d3-082a495fb563 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:33.323925 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fb1f2c75-c8dd-407e-a0d3-082a495fb563 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:33.324365 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fb1f2c75-c8dd-407e-a0d3-082a495fb563 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:33.325087 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fb1f2c75-c8dd-407e-a0d3-082a495fb563 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:33.325548 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fb1f2c75-c8dd-407e-a0d3-082a495fb563 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:33.326148 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fb1f2c75-c8dd-407e-a0d3-082a495fb563 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:33.483399 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.network.security_group_api [None req-fb1f2c75-c8dd-407e-a0d3-082a495fb563 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Adding security group 371b7b01-26df-414a-8083-afc5a769decd to port 9431c858-ac93-4f2b-a673-fd8e539b68c8 Aug 26 11:07:33.794919 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-84183e42-eb76-4a9a-9413-4202424bb0b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:33.796975 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-84183e42-eb76-4a9a-9413-4202424bb0b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:33.828159 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-84183e42-eb76-4a9a-9413-4202424bb0b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:33.829393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-84183e42-eb76-4a9a-9413-4202424bb0b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:33.829890 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-84183e42-eb76-4a9a-9413-4202424bb0b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:33.830732 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-84183e42-eb76-4a9a-9413-4202424bb0b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:33.831117 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-84183e42-eb76-4a9a-9413-4202424bb0b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:33.831575 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-84183e42-eb76-4a9a-9413-4202424bb0b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:34.093554 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-84183e42-eb76-4a9a-9413-4202424bb0b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:34.100275 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:34.111198 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-84183e42-eb76-4a9a-9413-4202424bb0b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:34.112771 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-84183e42-eb76-4a9a-9413-4202424bb0b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:34.116206 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-84183e42-eb76-4a9a-9413-4202424bb0b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.333240 Aug 26 11:07:34.116829 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 200/381] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:33 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:34.302514 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5572ae6e-1502-4f88-93ca-60460054c9b9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:34.303600 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5572ae6e-1502-4f88-93ca-60460054c9b9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:34.313161 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5572ae6e-1502-4f88-93ca-60460054c9b9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:34.314142 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5572ae6e-1502-4f88-93ca-60460054c9b9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:34.314837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5572ae6e-1502-4f88-93ca-60460054c9b9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:34.316020 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5572ae6e-1502-4f88-93ca-60460054c9b9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:34.316623 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5572ae6e-1502-4f88-93ca-60460054c9b9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:34.317136 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5572ae6e-1502-4f88-93ca-60460054c9b9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:34.352252 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-fb1f2c75-c8dd-407e-a0d3-082a495fb563 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "POST /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/action" status: 202 len: 0 microversion: 2.1 time: 1.044270 Aug 26 11:07:34.354311 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 182/382] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 11:07:33 2022] POST /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/action => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:07:34.359856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-688e76e3-8e1e-4832-87d5-578c64a8d6f9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:34.361063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-688e76e3-8e1e-4832-87d5-578c64a8d6f9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:34.369371 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-688e76e3-8e1e-4832-87d5-578c64a8d6f9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:34.369904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-688e76e3-8e1e-4832-87d5-578c64a8d6f9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:34.370384 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-688e76e3-8e1e-4832-87d5-578c64a8d6f9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:34.371107 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-688e76e3-8e1e-4832-87d5-578c64a8d6f9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:34.371829 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-688e76e3-8e1e-4832-87d5-578c64a8d6f9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:34.372457 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-688e76e3-8e1e-4832-87d5-578c64a8d6f9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:34.477886 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5572ae6e-1502-4f88-93ca-60460054c9b9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:34.496375 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5572ae6e-1502-4f88-93ca-60460054c9b9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1279 microversion: 2.1 time: 0.199227 Aug 26 11:07:34.500841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 201/383] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:34 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1279 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:34.518701 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-29ce6125-51e1-472a-a643-377a33bc04b8 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:34.519463 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-29ce6125-51e1-472a-a643-377a33bc04b8 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:34.531306 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29ce6125-51e1-472a-a643-377a33bc04b8 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:34.532749 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29ce6125-51e1-472a-a643-377a33bc04b8 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:34.533422 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29ce6125-51e1-472a-a643-377a33bc04b8 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:34.534346 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29ce6125-51e1-472a-a643-377a33bc04b8 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:34.534960 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29ce6125-51e1-472a-a643-377a33bc04b8 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:34.535598 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29ce6125-51e1-472a-a643-377a33bc04b8 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:34.646285 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-688e76e3-8e1e-4832-87d5-578c64a8d6f9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:34.664105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-688e76e3-8e1e-4832-87d5-578c64a8d6f9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.302144 Aug 26 11:07:34.678624 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 183/384] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:34 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:34.686037 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-7067735e-7b5d-4948-a979-16392b55b152 req-a5b98940-b177-4222-b411-e57215e5f871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136f48c9-a521-4bc3-b6cc-98da91d02c49", "tag": "9431c858-ac93-4f2b-a673-fd8e539b68c8"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:34.702128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-7067735e-7b5d-4948-a979-16392b55b152 req-a5b98940-b177-4222-b411-e57215e5f871 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:34.702925 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-7067735e-7b5d-4948-a979-16392b55b152 req-a5b98940-b177-4222-b411-e57215e5f871 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:34.703541 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-7067735e-7b5d-4948-a979-16392b55b152 req-a5b98940-b177-4222-b411-e57215e5f871 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:34.725716 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-7067735e-7b5d-4948-a979-16392b55b152 req-a5b98940-b177-4222-b411-e57215e5f871 service nova] Creating event network-changed:9431c858-ac93-4f2b-a673-fd8e539b68c8 for instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 on hv-cinder-85236 Aug 26 11:07:34.731490 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-7067735e-7b5d-4948-a979-16392b55b152 req-a5b98940-b177-4222-b411-e57215e5f871 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051130 Aug 26 11:07:34.732196 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 184/385] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:07:34.815855 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-29ce6125-51e1-472a-a643-377a33bc04b8 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:34.827109 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-29ce6125-51e1-472a-a643-377a33bc04b8 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1755 microversion: 2.1 time: 0.321771 Aug 26 11:07:34.828159 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 202/386] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:34 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1755 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:35.155234 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7f75a542-1ce7-4063-8578-807c3efd3938 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:35.156274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7f75a542-1ce7-4063-8578-807c3efd3938 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:35.163209 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f75a542-1ce7-4063-8578-807c3efd3938 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:35.163758 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f75a542-1ce7-4063-8578-807c3efd3938 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:35.164203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f75a542-1ce7-4063-8578-807c3efd3938 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:35.165055 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f75a542-1ce7-4063-8578-807c3efd3938 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:35.166788 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f75a542-1ce7-4063-8578-807c3efd3938 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:35.168160 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f75a542-1ce7-4063-8578-807c3efd3938 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:35.383766 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7f75a542-1ce7-4063-8578-807c3efd3938 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:35.393345 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7f75a542-1ce7-4063-8578-807c3efd3938 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:35.395364 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7f75a542-1ce7-4063-8578-807c3efd3938 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:35.396970 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7f75a542-1ce7-4063-8578-807c3efd3938 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.247008 Aug 26 11:07:35.397546 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 185/387] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:35 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:35.524766 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b48c05e8-5885-439d-bfe0-1729df3bc52c tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:35.525394 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b48c05e8-5885-439d-bfe0-1729df3bc52c tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:35.533234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b48c05e8-5885-439d-bfe0-1729df3bc52c tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:35.534033 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b48c05e8-5885-439d-bfe0-1729df3bc52c tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:35.534478 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b48c05e8-5885-439d-bfe0-1729df3bc52c tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:35.535844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b48c05e8-5885-439d-bfe0-1729df3bc52c tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:35.536471 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b48c05e8-5885-439d-bfe0-1729df3bc52c tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:35.536901 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b48c05e8-5885-439d-bfe0-1729df3bc52c tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:35.613296 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b48c05e8-5885-439d-bfe0-1729df3bc52c tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:35.622434 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b48c05e8-5885-439d-bfe0-1729df3bc52c tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1279 microversion: 2.1 time: 0.105370 Aug 26 11:07:35.623028 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 203/388] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:35 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1279 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:35.692308 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-81c95b8f-da8e-4e85-ac3c-2b93ef2e2da2 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:35.693328 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-81c95b8f-da8e-4e85-ac3c-2b93ef2e2da2 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:35.699933 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81c95b8f-da8e-4e85-ac3c-2b93ef2e2da2 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:35.700463 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81c95b8f-da8e-4e85-ac3c-2b93ef2e2da2 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:35.700902 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81c95b8f-da8e-4e85-ac3c-2b93ef2e2da2 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:35.701680 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81c95b8f-da8e-4e85-ac3c-2b93ef2e2da2 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:35.702175 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81c95b8f-da8e-4e85-ac3c-2b93ef2e2da2 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:35.702646 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81c95b8f-da8e-4e85-ac3c-2b93ef2e2da2 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:35.860525 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-81c95b8f-da8e-4e85-ac3c-2b93ef2e2da2 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:35.873136 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-81c95b8f-da8e-4e85-ac3c-2b93ef2e2da2 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.185372 Aug 26 11:07:35.873786 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 186/389] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:35 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:36.420294 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-464a7f55-a869-4c39-8b67-2d636e4db080 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:36.421548 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-464a7f55-a869-4c39-8b67-2d636e4db080 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:36.430361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-464a7f55-a869-4c39-8b67-2d636e4db080 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:36.430876 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-464a7f55-a869-4c39-8b67-2d636e4db080 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:36.431307 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-464a7f55-a869-4c39-8b67-2d636e4db080 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:36.432021 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-464a7f55-a869-4c39-8b67-2d636e4db080 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:36.432468 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-464a7f55-a869-4c39-8b67-2d636e4db080 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:36.432879 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-464a7f55-a869-4c39-8b67-2d636e4db080 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:36.612764 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-464a7f55-a869-4c39-8b67-2d636e4db080 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:36.623844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-464a7f55-a869-4c39-8b67-2d636e4db080 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:36.625346 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-464a7f55-a869-4c39-8b67-2d636e4db080 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:36.626577 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-464a7f55-a869-4c39-8b67-2d636e4db080 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.210318 Aug 26 11:07:36.627148 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 204/390] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:36 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:36.650866 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8fbbd59a-d6a1-48b9-8b22-c251ff934437 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:36.651720 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8fbbd59a-d6a1-48b9-8b22-c251ff934437 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:36.662219 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8fbbd59a-d6a1-48b9-8b22-c251ff934437 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:36.662898 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8fbbd59a-d6a1-48b9-8b22-c251ff934437 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:36.663365 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8fbbd59a-d6a1-48b9-8b22-c251ff934437 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:36.670745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8fbbd59a-d6a1-48b9-8b22-c251ff934437 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:36.671319 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8fbbd59a-d6a1-48b9-8b22-c251ff934437 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:36.671768 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8fbbd59a-d6a1-48b9-8b22-c251ff934437 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:36.749400 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8fbbd59a-d6a1-48b9-8b22-c251ff934437 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:36.761135 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8fbbd59a-d6a1-48b9-8b22-c251ff934437 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1279 microversion: 2.1 time: 0.114343 Aug 26 11:07:36.761842 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 187/391] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:36 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1279 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:36.903469 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-dd2660b4-b4fe-46ff-a3d4-332a5cbb99d6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:36.903469 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-dd2660b4-b4fe-46ff-a3d4-332a5cbb99d6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:36.927280 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dd2660b4-b4fe-46ff-a3d4-332a5cbb99d6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:36.928145 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dd2660b4-b4fe-46ff-a3d4-332a5cbb99d6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:36.929368 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dd2660b4-b4fe-46ff-a3d4-332a5cbb99d6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:36.930185 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dd2660b4-b4fe-46ff-a3d4-332a5cbb99d6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:36.930620 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dd2660b4-b4fe-46ff-a3d4-332a5cbb99d6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:36.931061 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dd2660b4-b4fe-46ff-a3d4-332a5cbb99d6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:37.108503 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-dd2660b4-b4fe-46ff-a3d4-332a5cbb99d6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:37.118243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-dd2660b4-b4fe-46ff-a3d4-332a5cbb99d6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.223126 Aug 26 11:07:37.119094 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 205/392] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:36 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:37.658512 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-598a6b8c-edbe-4ef7-87ba-07c34de98a6f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:37.659971 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-598a6b8c-edbe-4ef7-87ba-07c34de98a6f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:37.667633 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-598a6b8c-edbe-4ef7-87ba-07c34de98a6f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:37.668119 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-598a6b8c-edbe-4ef7-87ba-07c34de98a6f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:37.668553 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-598a6b8c-edbe-4ef7-87ba-07c34de98a6f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:37.669256 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-598a6b8c-edbe-4ef7-87ba-07c34de98a6f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:37.669704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-598a6b8c-edbe-4ef7-87ba-07c34de98a6f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:37.670156 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-598a6b8c-edbe-4ef7-87ba-07c34de98a6f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:37.784959 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-7d66ee74-20de-4b89-aac9-1a77ea99b2a9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:37.786097 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-7d66ee74-20de-4b89-aac9-1a77ea99b2a9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:37.792607 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d66ee74-20de-4b89-aac9-1a77ea99b2a9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:37.793041 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d66ee74-20de-4b89-aac9-1a77ea99b2a9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:37.793473 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d66ee74-20de-4b89-aac9-1a77ea99b2a9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:37.794205 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d66ee74-20de-4b89-aac9-1a77ea99b2a9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:37.794758 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d66ee74-20de-4b89-aac9-1a77ea99b2a9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:37.795071 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d66ee74-20de-4b89-aac9-1a77ea99b2a9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:37.826271 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-598a6b8c-edbe-4ef7-87ba-07c34de98a6f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:37.834157 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-598a6b8c-edbe-4ef7-87ba-07c34de98a6f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:37.835951 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-598a6b8c-edbe-4ef7-87ba-07c34de98a6f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:37.837283 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-598a6b8c-edbe-4ef7-87ba-07c34de98a6f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.184407 Aug 26 11:07:37.838277 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 188/393] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:37 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:37.874145 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7d66ee74-20de-4b89-aac9-1a77ea99b2a9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:37.883959 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-7d66ee74-20de-4b89-aac9-1a77ea99b2a9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1279 microversion: 2.1 time: 0.102575 Aug 26 11:07:37.884970 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 206/394] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:37 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1279 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:38.140521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-14c75b93-3588-4f73-824b-1f8ce1de709c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:38.141121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-14c75b93-3588-4f73-824b-1f8ce1de709c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:38.147582 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14c75b93-3588-4f73-824b-1f8ce1de709c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:38.148071 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14c75b93-3588-4f73-824b-1f8ce1de709c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:38.148506 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14c75b93-3588-4f73-824b-1f8ce1de709c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:38.149205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14c75b93-3588-4f73-824b-1f8ce1de709c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:38.149654 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14c75b93-3588-4f73-824b-1f8ce1de709c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:38.150107 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14c75b93-3588-4f73-824b-1f8ce1de709c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:38.304710 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-14c75b93-3588-4f73-824b-1f8ce1de709c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:38.315941 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-14c75b93-3588-4f73-824b-1f8ce1de709c tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.178874 Aug 26 11:07:38.316205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 189/395] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:38 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:38.865414 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-9d141bd5-906c-4428-a69b-d7354b418675 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:38.866359 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9d141bd5-906c-4428-a69b-d7354b418675 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:38.875715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9d141bd5-906c-4428-a69b-d7354b418675 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:38.876218 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9d141bd5-906c-4428-a69b-d7354b418675 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:38.876683 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9d141bd5-906c-4428-a69b-d7354b418675 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:38.877436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9d141bd5-906c-4428-a69b-d7354b418675 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:38.879650 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9d141bd5-906c-4428-a69b-d7354b418675 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:38.879650 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9d141bd5-906c-4428-a69b-d7354b418675 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:38.906390 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-929995dd-30fb-4a0b-90f3-192c2d443cd5 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:38.906991 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-929995dd-30fb-4a0b-90f3-192c2d443cd5 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:38.914143 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-929995dd-30fb-4a0b-90f3-192c2d443cd5 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:38.914790 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-929995dd-30fb-4a0b-90f3-192c2d443cd5 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:38.915537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-929995dd-30fb-4a0b-90f3-192c2d443cd5 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:38.916277 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-929995dd-30fb-4a0b-90f3-192c2d443cd5 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:38.916855 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-929995dd-30fb-4a0b-90f3-192c2d443cd5 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:38.917277 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-929995dd-30fb-4a0b-90f3-192c2d443cd5 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:39.003178 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-929995dd-30fb-4a0b-90f3-192c2d443cd5 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:39.012260 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-929995dd-30fb-4a0b-90f3-192c2d443cd5 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1279 microversion: 2.1 time: 0.110055 Aug 26 11:07:39.013126 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 190/396] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:38 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1279 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:39.057610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9d141bd5-906c-4428-a69b-d7354b418675 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:39.069948 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9d141bd5-906c-4428-a69b-d7354b418675 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:39.074607 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9d141bd5-906c-4428-a69b-d7354b418675 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:39.074607 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-9d141bd5-906c-4428-a69b-d7354b418675 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.211958 Aug 26 11:07:39.090839 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 207/397] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:38 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:39.342277 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-781a9f2b-3dce-4fd0-bff5-70ce44ea4bbe tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:39.342920 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-781a9f2b-3dce-4fd0-bff5-70ce44ea4bbe tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:39.349810 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-781a9f2b-3dce-4fd0-bff5-70ce44ea4bbe tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:39.350332 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-781a9f2b-3dce-4fd0-bff5-70ce44ea4bbe tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:39.350772 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-781a9f2b-3dce-4fd0-bff5-70ce44ea4bbe tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:39.351478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-781a9f2b-3dce-4fd0-bff5-70ce44ea4bbe tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:39.351955 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-781a9f2b-3dce-4fd0-bff5-70ce44ea4bbe tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:39.352481 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-781a9f2b-3dce-4fd0-bff5-70ce44ea4bbe tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:39.504915 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-781a9f2b-3dce-4fd0-bff5-70ce44ea4bbe tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:39.513765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-781a9f2b-3dce-4fd0-bff5-70ce44ea4bbe tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.175816 Aug 26 11:07:39.514687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 191/398] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:39 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:40.033635 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-50240a3e-9428-4cbe-a37f-b7ca8c7213d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:40.034451 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-50240a3e-9428-4cbe-a37f-b7ca8c7213d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:40.043690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-50240a3e-9428-4cbe-a37f-b7ca8c7213d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:40.044458 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-50240a3e-9428-4cbe-a37f-b7ca8c7213d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:40.045257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-50240a3e-9428-4cbe-a37f-b7ca8c7213d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:40.046246 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-50240a3e-9428-4cbe-a37f-b7ca8c7213d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:40.046770 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-50240a3e-9428-4cbe-a37f-b7ca8c7213d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:40.047729 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-50240a3e-9428-4cbe-a37f-b7ca8c7213d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:40.098265 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-acbd0afb-10a6-4943-b8e3-1ab3d0d83e3c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:40.099257 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-acbd0afb-10a6-4943-b8e3-1ab3d0d83e3c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:40.106266 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-acbd0afb-10a6-4943-b8e3-1ab3d0d83e3c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:40.106772 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-acbd0afb-10a6-4943-b8e3-1ab3d0d83e3c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:40.107282 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-acbd0afb-10a6-4943-b8e3-1ab3d0d83e3c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:40.108020 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-acbd0afb-10a6-4943-b8e3-1ab3d0d83e3c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:40.108581 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-acbd0afb-10a6-4943-b8e3-1ab3d0d83e3c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:40.109007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-acbd0afb-10a6-4943-b8e3-1ab3d0d83e3c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:40.125042 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-50240a3e-9428-4cbe-a37f-b7ca8c7213d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:40.134548 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-50240a3e-9428-4cbe-a37f-b7ca8c7213d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1279 microversion: 2.1 time: 0.105325 Aug 26 11:07:40.135364 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 208/399] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:40 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1279 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:40.278804 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-acbd0afb-10a6-4943-b8e3-1ab3d0d83e3c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:40.288533 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-acbd0afb-10a6-4943-b8e3-1ab3d0d83e3c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:40.289943 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-acbd0afb-10a6-4943-b8e3-1ab3d0d83e3c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:40.291364 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-acbd0afb-10a6-4943-b8e3-1ab3d0d83e3c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.198039 Aug 26 11:07:40.302203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 192/400] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:40 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:40.536391 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1cf8391f-6bd7-4c88-b32f-11fc312d6c14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:40.537010 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-1cf8391f-6bd7-4c88-b32f-11fc312d6c14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:40.543441 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1cf8391f-6bd7-4c88-b32f-11fc312d6c14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:40.543857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1cf8391f-6bd7-4c88-b32f-11fc312d6c14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:40.544409 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1cf8391f-6bd7-4c88-b32f-11fc312d6c14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:40.545029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1cf8391f-6bd7-4c88-b32f-11fc312d6c14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:40.545490 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1cf8391f-6bd7-4c88-b32f-11fc312d6c14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:40.545925 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1cf8391f-6bd7-4c88-b32f-11fc312d6c14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:40.701013 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1cf8391f-6bd7-4c88-b32f-11fc312d6c14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:40.717530 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1cf8391f-6bd7-4c88-b32f-11fc312d6c14 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.182381 Aug 26 11:07:40.718476 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 209/401] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:40 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:41.156466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d1fd8723-6341-490b-a4a0-cd0b780ea7f8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:41.157935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d1fd8723-6341-490b-a4a0-cd0b780ea7f8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:41.165273 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1fd8723-6341-490b-a4a0-cd0b780ea7f8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:41.165750 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1fd8723-6341-490b-a4a0-cd0b780ea7f8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:41.166282 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1fd8723-6341-490b-a4a0-cd0b780ea7f8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:41.166989 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1fd8723-6341-490b-a4a0-cd0b780ea7f8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:41.167468 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1fd8723-6341-490b-a4a0-cd0b780ea7f8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:41.167886 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1fd8723-6341-490b-a4a0-cd0b780ea7f8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:41.237944 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d1fd8723-6341-490b-a4a0-cd0b780ea7f8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:41.246702 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d1fd8723-6341-490b-a4a0-cd0b780ea7f8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1279 microversion: 2.1 time: 0.094863 Aug 26 11:07:41.247272 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 193/402] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:41 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:41.327959 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-6283d840-4806-4c47-a57a-8e6798055279 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:41.328998 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-6283d840-4806-4c47-a57a-8e6798055279 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:41.340339 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6283d840-4806-4c47-a57a-8e6798055279 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:41.341264 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6283d840-4806-4c47-a57a-8e6798055279 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:41.342003 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6283d840-4806-4c47-a57a-8e6798055279 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:41.343181 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6283d840-4806-4c47-a57a-8e6798055279 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:41.343952 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6283d840-4806-4c47-a57a-8e6798055279 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:41.344644 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6283d840-4806-4c47-a57a-8e6798055279 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:41.529317 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6283d840-4806-4c47-a57a-8e6798055279 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:41.540638 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6283d840-4806-4c47-a57a-8e6798055279 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:41.542656 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6283d840-4806-4c47-a57a-8e6798055279 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:41.544377 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-6283d840-4806-4c47-a57a-8e6798055279 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.220708 Aug 26 11:07:41.546582 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 210/403] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:41 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:41.747526 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-87917ef6-3d5a-4dfa-aae4-d3aaed4bbfc4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:41.748042 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-87917ef6-3d5a-4dfa-aae4-d3aaed4bbfc4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:41.755078 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-87917ef6-3d5a-4dfa-aae4-d3aaed4bbfc4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:41.755571 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-87917ef6-3d5a-4dfa-aae4-d3aaed4bbfc4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:41.756010 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-87917ef6-3d5a-4dfa-aae4-d3aaed4bbfc4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:41.756718 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-87917ef6-3d5a-4dfa-aae4-d3aaed4bbfc4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:41.757174 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-87917ef6-3d5a-4dfa-aae4-d3aaed4bbfc4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:41.757600 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-87917ef6-3d5a-4dfa-aae4-d3aaed4bbfc4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:41.932169 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-87917ef6-3d5a-4dfa-aae4-d3aaed4bbfc4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:41.942356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-87917ef6-3d5a-4dfa-aae4-d3aaed4bbfc4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.198507 Aug 26 11:07:41.943759 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 194/404] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:41 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:42.268942 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-24153854-d8b5-4309-9ef0-8efa0704cf38 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:42.269668 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-24153854-d8b5-4309-9ef0-8efa0704cf38 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:42.271615 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:42.272366 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=6 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:42.291689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-24153854-d8b5-4309-9ef0-8efa0704cf38 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:42.292298 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-24153854-d8b5-4309-9ef0-8efa0704cf38 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:42.292807 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-24153854-d8b5-4309-9ef0-8efa0704cf38 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:42.293585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-24153854-d8b5-4309-9ef0-8efa0704cf38 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:42.294120 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-24153854-d8b5-4309-9ef0-8efa0704cf38 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:42.294608 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-24153854-d8b5-4309-9ef0-8efa0704cf38 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:42.487314 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-24153854-d8b5-4309-9ef0-8efa0704cf38 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:42.487314 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-24153854-d8b5-4309-9ef0-8efa0704cf38 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1279 microversion: 2.1 time: 0.120881 Aug 26 11:07:42.487314 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 211/405] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:42 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1279 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:42.572814 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a9243c87-3a3e-4414-af50-147be72871bd tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:42.573520 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a9243c87-3a3e-4414-af50-147be72871bd tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:42.575899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:42.583485 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a9243c87-3a3e-4414-af50-147be72871bd tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:42.583955 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a9243c87-3a3e-4414-af50-147be72871bd tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:42.584374 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a9243c87-3a3e-4414-af50-147be72871bd tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:42.585155 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a9243c87-3a3e-4414-af50-147be72871bd tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:42.585901 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a9243c87-3a3e-4414-af50-147be72871bd tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:42.586374 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a9243c87-3a3e-4414-af50-147be72871bd tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:42.591496 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=100 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:42.732320 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a9243c87-3a3e-4414-af50-147be72871bd tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:42.743042 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a9243c87-3a3e-4414-af50-147be72871bd tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:42.744900 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a9243c87-3a3e-4414-af50-147be72871bd tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:42.746416 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a9243c87-3a3e-4414-af50-147be72871bd tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.180535 Aug 26 11:07:42.746877 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 195/406] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:42 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:42.972465 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-100b91b5-c8fa-4d23-a238-5d50570f856f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:42.973496 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-100b91b5-c8fa-4d23-a238-5d50570f856f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:42.981340 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-100b91b5-c8fa-4d23-a238-5d50570f856f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:42.981857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-100b91b5-c8fa-4d23-a238-5d50570f856f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:42.982416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-100b91b5-c8fa-4d23-a238-5d50570f856f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:42.983179 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-100b91b5-c8fa-4d23-a238-5d50570f856f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:42.983726 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-100b91b5-c8fa-4d23-a238-5d50570f856f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:42.984209 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-100b91b5-c8fa-4d23-a238-5d50570f856f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:43.132540 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-100b91b5-c8fa-4d23-a238-5d50570f856f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:43.141926 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-100b91b5-c8fa-4d23-a238-5d50570f856f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1723 microversion: 2.1 time: 0.173979 Aug 26 11:07:43.142595 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 212/407] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:42 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:43.419850 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-10c13faa-1f93-470a-855c-29e00148a3b4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:43.420999 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-10c13faa-1f93-470a-855c-29e00148a3b4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:43.424368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:43.435763 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10c13faa-1f93-470a-855c-29e00148a3b4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:43.436647 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10c13faa-1f93-470a-855c-29e00148a3b4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:43.437494 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10c13faa-1f93-470a-855c-29e00148a3b4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:43.438702 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10c13faa-1f93-470a-855c-29e00148a3b4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:43.439529 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10c13faa-1f93-470a-855c-29e00148a3b4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:43.440299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10c13faa-1f93-470a-855c-29e00148a3b4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:43.520143 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-10c13faa-1f93-470a-855c-29e00148a3b4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:43.530430 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-10c13faa-1f93-470a-855c-29e00148a3b4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1289 microversion: 2.1 time: 0.123433 Aug 26 11:07:43.531195 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 196/408] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:43 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1289 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:43.778812 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-8315bd22-6a10-4685-9d7d-7b51860d21bb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:43.779367 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-8315bd22-6a10-4685-9d7d-7b51860d21bb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:43.785936 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8315bd22-6a10-4685-9d7d-7b51860d21bb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:43.786450 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8315bd22-6a10-4685-9d7d-7b51860d21bb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:43.786888 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8315bd22-6a10-4685-9d7d-7b51860d21bb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:43.787582 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8315bd22-6a10-4685-9d7d-7b51860d21bb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:43.788033 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8315bd22-6a10-4685-9d7d-7b51860d21bb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:43.788456 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8315bd22-6a10-4685-9d7d-7b51860d21bb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:43.931907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8315bd22-6a10-4685-9d7d-7b51860d21bb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:43.942241 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8315bd22-6a10-4685-9d7d-7b51860d21bb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:43.944072 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8315bd22-6a10-4685-9d7d-7b51860d21bb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:43.945327 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-8315bd22-6a10-4685-9d7d-7b51860d21bb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.170593 Aug 26 11:07:43.946736 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 213/409] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:43 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:44.168346 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-14fee15d-35f2-4aa0-81a8-5eb5ae935acd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:44.169863 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-14fee15d-35f2-4aa0-81a8-5eb5ae935acd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:44.178061 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14fee15d-35f2-4aa0-81a8-5eb5ae935acd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:44.178931 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14fee15d-35f2-4aa0-81a8-5eb5ae935acd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:44.179454 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14fee15d-35f2-4aa0-81a8-5eb5ae935acd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:44.180258 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14fee15d-35f2-4aa0-81a8-5eb5ae935acd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:44.180808 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14fee15d-35f2-4aa0-81a8-5eb5ae935acd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:44.181330 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-14fee15d-35f2-4aa0-81a8-5eb5ae935acd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:44.408855 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-14fee15d-35f2-4aa0-81a8-5eb5ae935acd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:44.418466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-14fee15d-35f2-4aa0-81a8-5eb5ae935acd tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1700 microversion: 2.1 time: 0.255953 Aug 26 11:07:44.431314 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 197/410] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:44 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1700 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:44.444800 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b9bc9f6d-305c-4479-884f-d6874f06e936 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:44.451042 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b9bc9f6d-305c-4479-884f-d6874f06e936 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:44.451530 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b9bc9f6d-305c-4479-884f-d6874f06e936 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:44.452197 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b9bc9f6d-305c-4479-884f-d6874f06e936 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:44.521700 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b9bc9f6d-305c-4479-884f-d6874f06e936 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Going to try to start instance {{(pid=120605) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 26 11:07:44.559747 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6260a6fb-628a-475c-ae4f-6793b62e97c2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:44.560615 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6260a6fb-628a-475c-ae4f-6793b62e97c2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:44.570617 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6260a6fb-628a-475c-ae4f-6793b62e97c2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:44.571764 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6260a6fb-628a-475c-ae4f-6793b62e97c2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:44.572459 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6260a6fb-628a-475c-ae4f-6793b62e97c2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:44.574238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6260a6fb-628a-475c-ae4f-6793b62e97c2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:44.574898 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6260a6fb-628a-475c-ae4f-6793b62e97c2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:44.575537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6260a6fb-628a-475c-ae4f-6793b62e97c2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:44.581760 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b9bc9f6d-305c-4479-884f-d6874f06e936 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "POST /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.142559 Aug 26 11:07:44.583395 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 214/411] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 11:07:44 2022] POST /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:07:44.609612 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-9f328658-0901-4fb8-a92e-73f460ce0c79 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:44.612520 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9f328658-0901-4fb8-a92e-73f460ce0c79 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:44.621089 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f328658-0901-4fb8-a92e-73f460ce0c79 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:44.621735 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f328658-0901-4fb8-a92e-73f460ce0c79 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:44.622323 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f328658-0901-4fb8-a92e-73f460ce0c79 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:44.623435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f328658-0901-4fb8-a92e-73f460ce0c79 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:44.623965 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f328658-0901-4fb8-a92e-73f460ce0c79 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:44.624460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f328658-0901-4fb8-a92e-73f460ce0c79 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:44.725334 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6260a6fb-628a-475c-ae4f-6793b62e97c2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:44.734899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6260a6fb-628a-475c-ae4f-6793b62e97c2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1277 microversion: 2.1 time: 0.183844 Aug 26 11:07:44.735832 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 198/412] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:44 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:44.896739 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9f328658-0901-4fb8-a92e-73f460ce0c79 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:44.906107 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-9f328658-0901-4fb8-a92e-73f460ce0c79 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1709 microversion: 2.1 time: 0.303976 Aug 26 11:07:44.906696 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 215/413] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:44 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1709 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:44.973343 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b8fe08c4-f798-4df4-a005-093307d6f828 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:44.974387 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b8fe08c4-f798-4df4-a005-093307d6f828 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:44.981365 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8fe08c4-f798-4df4-a005-093307d6f828 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:44.982003 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8fe08c4-f798-4df4-a005-093307d6f828 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:44.982509 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8fe08c4-f798-4df4-a005-093307d6f828 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:44.983309 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8fe08c4-f798-4df4-a005-093307d6f828 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:44.983830 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8fe08c4-f798-4df4-a005-093307d6f828 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:44.984322 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8fe08c4-f798-4df4-a005-093307d6f828 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:45.167238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b8fe08c4-f798-4df4-a005-093307d6f828 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:45.182148 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b8fe08c4-f798-4df4-a005-093307d6f828 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:45.183890 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b8fe08c4-f798-4df4-a005-093307d6f828 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:45.189930 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b8fe08c4-f798-4df4-a005-093307d6f828 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.221344 Aug 26 11:07:45.190787 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 199/414] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:44 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:45.756815 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-dfff677a-5735-47d4-877e-fdb3d80293d1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:45.757428 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-dfff677a-5735-47d4-877e-fdb3d80293d1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:45.764653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dfff677a-5735-47d4-877e-fdb3d80293d1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:45.765366 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dfff677a-5735-47d4-877e-fdb3d80293d1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:45.765798 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dfff677a-5735-47d4-877e-fdb3d80293d1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:45.766571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dfff677a-5735-47d4-877e-fdb3d80293d1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:45.767183 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dfff677a-5735-47d4-877e-fdb3d80293d1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:45.767600 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dfff677a-5735-47d4-877e-fdb3d80293d1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:45.792433 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:45.929336 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e07a1407-1dd3-463f-a541-6c5c2472fcff tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:45.930317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e07a1407-1dd3-463f-a541-6c5c2472fcff tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:45.936644 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e07a1407-1dd3-463f-a541-6c5c2472fcff tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:45.937474 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e07a1407-1dd3-463f-a541-6c5c2472fcff tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:45.938041 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e07a1407-1dd3-463f-a541-6c5c2472fcff tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:45.938981 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e07a1407-1dd3-463f-a541-6c5c2472fcff tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:45.940684 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e07a1407-1dd3-463f-a541-6c5c2472fcff tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:45.942091 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e07a1407-1dd3-463f-a541-6c5c2472fcff tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:45.958022 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-dfff677a-5735-47d4-877e-fdb3d80293d1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:45.972638 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-dfff677a-5735-47d4-877e-fdb3d80293d1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1319 microversion: 2.1 time: 0.220548 Aug 26 11:07:45.974077 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 216/415] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:45 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:46.107737 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e07a1407-1dd3-463f-a541-6c5c2472fcff tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:46.116606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e07a1407-1dd3-463f-a541-6c5c2472fcff tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1709 microversion: 2.1 time: 0.192047 Aug 26 11:07:46.117111 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 200/416] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:45 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1709 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:46.216218 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4da0b998-6e9e-468b-93a9-147397caca61 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:46.216865 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4da0b998-6e9e-468b-93a9-147397caca61 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:46.223454 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4da0b998-6e9e-468b-93a9-147397caca61 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:46.223943 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4da0b998-6e9e-468b-93a9-147397caca61 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:46.224370 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4da0b998-6e9e-468b-93a9-147397caca61 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:46.225074 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4da0b998-6e9e-468b-93a9-147397caca61 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:46.225523 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4da0b998-6e9e-468b-93a9-147397caca61 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:46.225941 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4da0b998-6e9e-468b-93a9-147397caca61 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:46.283030 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-ccb62e3a-86c8-4621-a9df-92b9d7c0eb7c req-6b51dc6d-c035-4b77-8e9a-65a3d3badecd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47cb1388-733b-490d-9c67-bee7fc7f5068", "tag": "886de8fb-f738-455e-92a7-cd1c58d3512d"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:46.295218 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-ccb62e3a-86c8-4621-a9df-92b9d7c0eb7c req-6b51dc6d-c035-4b77-8e9a-65a3d3badecd service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:46.295700 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-ccb62e3a-86c8-4621-a9df-92b9d7c0eb7c req-6b51dc6d-c035-4b77-8e9a-65a3d3badecd service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:46.296133 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-ccb62e3a-86c8-4621-a9df-92b9d7c0eb7c req-6b51dc6d-c035-4b77-8e9a-65a3d3badecd service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:46.311735 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-ccb62e3a-86c8-4621-a9df-92b9d7c0eb7c req-6b51dc6d-c035-4b77-8e9a-65a3d3badecd service nova] Creating event network-changed:886de8fb-f738-455e-92a7-cd1c58d3512d for instance 47cb1388-733b-490d-9c67-bee7fc7f5068 on hv-cinder-85236 Aug 26 11:07:46.330622 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-ccb62e3a-86c8-4621-a9df-92b9d7c0eb7c req-6b51dc6d-c035-4b77-8e9a-65a3d3badecd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049116 Aug 26 11:07:46.331263 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 201/417] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:07:46.400812 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4da0b998-6e9e-468b-93a9-147397caca61 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:46.411347 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4da0b998-6e9e-468b-93a9-147397caca61 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:46.412961 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4da0b998-6e9e-468b-93a9-147397caca61 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:46.414204 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4da0b998-6e9e-468b-93a9-147397caca61 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.201997 Aug 26 11:07:46.414774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 217/418] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:46 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:46.998132 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4d35689e-5039-4dfc-9dfd-2534fb52faa8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:46.999170 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4d35689e-5039-4dfc-9dfd-2534fb52faa8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:47.008443 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d35689e-5039-4dfc-9dfd-2534fb52faa8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:47.009028 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d35689e-5039-4dfc-9dfd-2534fb52faa8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:47.009656 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d35689e-5039-4dfc-9dfd-2534fb52faa8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:47.010694 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d35689e-5039-4dfc-9dfd-2534fb52faa8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:47.011262 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d35689e-5039-4dfc-9dfd-2534fb52faa8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:47.011778 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d35689e-5039-4dfc-9dfd-2534fb52faa8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:47.144581 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-71f35e63-c8ff-4bed-aa57-3efa3f7ff095 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:47.145868 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-71f35e63-c8ff-4bed-aa57-3efa3f7ff095 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:47.153233 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-71f35e63-c8ff-4bed-aa57-3efa3f7ff095 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:47.153729 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-71f35e63-c8ff-4bed-aa57-3efa3f7ff095 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:47.154201 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-71f35e63-c8ff-4bed-aa57-3efa3f7ff095 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:47.154914 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-71f35e63-c8ff-4bed-aa57-3efa3f7ff095 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:47.155392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-71f35e63-c8ff-4bed-aa57-3efa3f7ff095 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:47.155805 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-71f35e63-c8ff-4bed-aa57-3efa3f7ff095 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:47.210321 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4d35689e-5039-4dfc-9dfd-2534fb52faa8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:47.219523 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4d35689e-5039-4dfc-9dfd-2534fb52faa8 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1319 microversion: 2.1 time: 0.226809 Aug 26 11:07:47.220314 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 202/419] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:46 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:47.304135 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-71f35e63-c8ff-4bed-aa57-3efa3f7ff095 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:47.313551 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-71f35e63-c8ff-4bed-aa57-3efa3f7ff095 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1713 microversion: 2.1 time: 0.177909 Aug 26 11:07:47.314142 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 218/420] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:47 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1713 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:47.437780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6fcc8491-9097-444f-ac45-1965ae2bdf37 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:47.438428 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6fcc8491-9097-444f-ac45-1965ae2bdf37 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:47.445097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6fcc8491-9097-444f-ac45-1965ae2bdf37 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:47.445579 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6fcc8491-9097-444f-ac45-1965ae2bdf37 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:47.446041 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6fcc8491-9097-444f-ac45-1965ae2bdf37 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:47.446743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6fcc8491-9097-444f-ac45-1965ae2bdf37 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:47.447191 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6fcc8491-9097-444f-ac45-1965ae2bdf37 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:47.447610 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6fcc8491-9097-444f-ac45-1965ae2bdf37 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:47.584682 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6fcc8491-9097-444f-ac45-1965ae2bdf37 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:47.594570 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6fcc8491-9097-444f-ac45-1965ae2bdf37 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:47.596229 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6fcc8491-9097-444f-ac45-1965ae2bdf37 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:47.597604 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6fcc8491-9097-444f-ac45-1965ae2bdf37 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.163816 Aug 26 11:07:47.598581 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 203/421] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:47 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:48.241457 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-87a8473f-835c-4a11-b559-28ea1ed6f163 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:48.242159 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-87a8473f-835c-4a11-b559-28ea1ed6f163 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:48.248962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-87a8473f-835c-4a11-b559-28ea1ed6f163 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:48.249450 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-87a8473f-835c-4a11-b559-28ea1ed6f163 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:48.249881 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-87a8473f-835c-4a11-b559-28ea1ed6f163 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:48.250639 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-87a8473f-835c-4a11-b559-28ea1ed6f163 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:48.251097 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-87a8473f-835c-4a11-b559-28ea1ed6f163 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:48.251540 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-87a8473f-835c-4a11-b559-28ea1ed6f163 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:48.385440 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-87a8473f-835c-4a11-b559-28ea1ed6f163 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:48.393106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-87a8473f-835c-4a11-b559-28ea1ed6f163 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1319 microversion: 2.1 time: 0.156156 Aug 26 11:07:48.393748 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 219/422] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:48 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:48.624501 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4d55ad31-e58b-434c-977a-7613cd86333f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:48.625150 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4d55ad31-e58b-434c-977a-7613cd86333f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:48.632257 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d55ad31-e58b-434c-977a-7613cd86333f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:48.632746 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d55ad31-e58b-434c-977a-7613cd86333f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:48.633183 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d55ad31-e58b-434c-977a-7613cd86333f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:48.633882 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d55ad31-e58b-434c-977a-7613cd86333f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:48.634376 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d55ad31-e58b-434c-977a-7613cd86333f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:48.634800 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d55ad31-e58b-434c-977a-7613cd86333f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:48.780769 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4d55ad31-e58b-434c-977a-7613cd86333f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:48.790533 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4d55ad31-e58b-434c-977a-7613cd86333f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:48.792115 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4d55ad31-e58b-434c-977a-7613cd86333f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:48.793432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4d55ad31-e58b-434c-977a-7613cd86333f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.173175 Aug 26 11:07:48.794040 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 204/423] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:48 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:07:49.414411 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-2f62bd77-a40c-4cb4-84ed-00f99ba827f3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:49.415026 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-2f62bd77-a40c-4cb4-84ed-00f99ba827f3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:49.421650 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2f62bd77-a40c-4cb4-84ed-00f99ba827f3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:49.422175 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2f62bd77-a40c-4cb4-84ed-00f99ba827f3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:49.422619 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2f62bd77-a40c-4cb4-84ed-00f99ba827f3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:49.423318 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2f62bd77-a40c-4cb4-84ed-00f99ba827f3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:49.423771 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2f62bd77-a40c-4cb4-84ed-00f99ba827f3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:49.424199 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2f62bd77-a40c-4cb4-84ed-00f99ba827f3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:49.564708 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-2f62bd77-a40c-4cb4-84ed-00f99ba827f3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:49.573858 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-2f62bd77-a40c-4cb4-84ed-00f99ba827f3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1319 microversion: 2.1 time: 0.163995 Aug 26 11:07:49.574461 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 220/424] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:49 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:49.816787 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-88c2ea08-e690-4f29-a1e3-2a5f636637b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:49.817572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-88c2ea08-e690-4f29-a1e3-2a5f636637b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:49.824179 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88c2ea08-e690-4f29-a1e3-2a5f636637b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:49.824660 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88c2ea08-e690-4f29-a1e3-2a5f636637b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:49.825097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88c2ea08-e690-4f29-a1e3-2a5f636637b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:49.825787 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88c2ea08-e690-4f29-a1e3-2a5f636637b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:49.826272 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88c2ea08-e690-4f29-a1e3-2a5f636637b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:49.826696 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88c2ea08-e690-4f29-a1e3-2a5f636637b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:49.967962 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-88c2ea08-e690-4f29-a1e3-2a5f636637b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:49.979430 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-88c2ea08-e690-4f29-a1e3-2a5f636637b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:49.981040 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-88c2ea08-e690-4f29-a1e3-2a5f636637b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:49.982430 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-88c2ea08-e690-4f29-a1e3-2a5f636637b9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.169591 Aug 26 11:07:49.983064 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 205/425] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:49 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:50.596104 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-6d6e6c18-0bff-4979-a25c-9b52fa9c230b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:50.596851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-6d6e6c18-0bff-4979-a25c-9b52fa9c230b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:50.605284 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d6e6c18-0bff-4979-a25c-9b52fa9c230b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:50.605890 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d6e6c18-0bff-4979-a25c-9b52fa9c230b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:50.606475 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d6e6c18-0bff-4979-a25c-9b52fa9c230b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:50.607300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d6e6c18-0bff-4979-a25c-9b52fa9c230b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:50.607847 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d6e6c18-0bff-4979-a25c-9b52fa9c230b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:50.608331 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d6e6c18-0bff-4979-a25c-9b52fa9c230b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:50.756478 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6d6e6c18-0bff-4979-a25c-9b52fa9c230b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:50.763996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-6d6e6c18-0bff-4979-a25c-9b52fa9c230b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1319 microversion: 2.1 time: 0.172638 Aug 26 11:07:50.764564 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 221/426] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:50 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:51.011050 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5da253fb-01df-424a-bbfb-560f349d26b3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:51.011916 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5da253fb-01df-424a-bbfb-560f349d26b3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:51.020369 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5da253fb-01df-424a-bbfb-560f349d26b3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:51.020872 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5da253fb-01df-424a-bbfb-560f349d26b3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:51.026765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5da253fb-01df-424a-bbfb-560f349d26b3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:51.026765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5da253fb-01df-424a-bbfb-560f349d26b3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:51.026765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5da253fb-01df-424a-bbfb-560f349d26b3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:51.026765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5da253fb-01df-424a-bbfb-560f349d26b3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:51.179997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5da253fb-01df-424a-bbfb-560f349d26b3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:51.189119 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5da253fb-01df-424a-bbfb-560f349d26b3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:51.190600 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5da253fb-01df-424a-bbfb-560f349d26b3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:51.192023 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5da253fb-01df-424a-bbfb-560f349d26b3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.186416 Aug 26 11:07:51.192588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 206/427] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:51 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:51.788089 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-26739b41-c20f-498e-a386-fbcd844f5a9f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:51.788974 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-26739b41-c20f-498e-a386-fbcd844f5a9f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:51.796850 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-26739b41-c20f-498e-a386-fbcd844f5a9f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:51.797429 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-26739b41-c20f-498e-a386-fbcd844f5a9f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:51.798050 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-26739b41-c20f-498e-a386-fbcd844f5a9f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:51.798929 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-26739b41-c20f-498e-a386-fbcd844f5a9f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:51.799457 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-26739b41-c20f-498e-a386-fbcd844f5a9f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:51.799991 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-26739b41-c20f-498e-a386-fbcd844f5a9f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:51.962366 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-26739b41-c20f-498e-a386-fbcd844f5a9f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:51.974765 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-26739b41-c20f-498e-a386-fbcd844f5a9f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1319 microversion: 2.1 time: 0.190231 Aug 26 11:07:51.975460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 222/428] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:51 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:52.230064 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-eaf6e2fe-a3f1-4903-8b1f-90cc59370c46 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:52.230948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-eaf6e2fe-a3f1-4903-8b1f-90cc59370c46 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:52.243344 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eaf6e2fe-a3f1-4903-8b1f-90cc59370c46 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:52.244186 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eaf6e2fe-a3f1-4903-8b1f-90cc59370c46 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:52.244657 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eaf6e2fe-a3f1-4903-8b1f-90cc59370c46 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:52.245433 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eaf6e2fe-a3f1-4903-8b1f-90cc59370c46 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:52.245932 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eaf6e2fe-a3f1-4903-8b1f-90cc59370c46 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:52.246401 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eaf6e2fe-a3f1-4903-8b1f-90cc59370c46 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:52.395792 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-eaf6e2fe-a3f1-4903-8b1f-90cc59370c46 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:52.406265 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-eaf6e2fe-a3f1-4903-8b1f-90cc59370c46 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:52.407873 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-eaf6e2fe-a3f1-4903-8b1f-90cc59370c46 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:52.409349 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-eaf6e2fe-a3f1-4903-8b1f-90cc59370c46 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.189202 Aug 26 11:07:52.410191 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 207/429] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:52 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:53.002442 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4e15efaa-cf29-4905-b3f7-86c19fc5429d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:53.003055 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4e15efaa-cf29-4905-b3f7-86c19fc5429d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:53.009871 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e15efaa-cf29-4905-b3f7-86c19fc5429d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:53.010390 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e15efaa-cf29-4905-b3f7-86c19fc5429d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:53.010828 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e15efaa-cf29-4905-b3f7-86c19fc5429d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:53.011533 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e15efaa-cf29-4905-b3f7-86c19fc5429d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:53.011978 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e15efaa-cf29-4905-b3f7-86c19fc5429d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:53.012401 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e15efaa-cf29-4905-b3f7-86c19fc5429d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:53.157445 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4e15efaa-cf29-4905-b3f7-86c19fc5429d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:53.165492 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4e15efaa-cf29-4905-b3f7-86c19fc5429d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1319 microversion: 2.1 time: 0.166852 Aug 26 11:07:53.166104 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 223/430] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:52 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:53.434826 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-45027b03-5b2c-46e1-8959-3639c6419062 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:53.435437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-45027b03-5b2c-46e1-8959-3639c6419062 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:53.441954 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45027b03-5b2c-46e1-8959-3639c6419062 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:53.442471 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45027b03-5b2c-46e1-8959-3639c6419062 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:53.442952 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45027b03-5b2c-46e1-8959-3639c6419062 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:53.443624 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45027b03-5b2c-46e1-8959-3639c6419062 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:53.444078 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45027b03-5b2c-46e1-8959-3639c6419062 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:53.444538 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45027b03-5b2c-46e1-8959-3639c6419062 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:53.571882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-5d5d23f1-fb4c-4cef-b230-2e3173588eea req-990acdab-e227-4bfa-9813-0319afbcf282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ae91d9-0521-4d14-b2b6-e56f249c4181", "name": "network-vif-plugged", "status": "completed", "tag": "36a4faa3-3a22-4156-8542-c0c5ea7e7f1c"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:53.583940 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-5d5d23f1-fb4c-4cef-b230-2e3173588eea req-990acdab-e227-4bfa-9813-0319afbcf282 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:53.584137 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-5d5d23f1-fb4c-4cef-b230-2e3173588eea req-990acdab-e227-4bfa-9813-0319afbcf282 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:53.584690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-5d5d23f1-fb4c-4cef-b230-2e3173588eea req-990acdab-e227-4bfa-9813-0319afbcf282 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:53.595898 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-45027b03-5b2c-46e1-8959-3639c6419062 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:53.604462 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-5d5d23f1-fb4c-4cef-b230-2e3173588eea req-990acdab-e227-4bfa-9813-0319afbcf282 service nova] Creating event network-vif-plugged:36a4faa3-3a22-4156-8542-c0c5ea7e7f1c for instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 on hv-cinder-85236 Aug 26 11:07:53.608576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-45027b03-5b2c-46e1-8959-3639c6419062 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:53.610103 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-45027b03-5b2c-46e1-8959-3639c6419062 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:53.610597 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-5d5d23f1-fb4c-4cef-b230-2e3173588eea req-990acdab-e227-4bfa-9813-0319afbcf282 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044574 Aug 26 11:07:53.611608 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 224/431] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:07:53.612220 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-45027b03-5b2c-46e1-8959-3639c6419062 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.182634 Aug 26 11:07:53.612775 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 208/432] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:53 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:54.188373 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-e8e22bc5-4b3f-48db-86a6-02746aecf6b7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:54.190000 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e8e22bc5-4b3f-48db-86a6-02746aecf6b7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:54.200889 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e8e22bc5-4b3f-48db-86a6-02746aecf6b7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:54.201630 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e8e22bc5-4b3f-48db-86a6-02746aecf6b7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:54.202443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e8e22bc5-4b3f-48db-86a6-02746aecf6b7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:54.203453 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e8e22bc5-4b3f-48db-86a6-02746aecf6b7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:54.204077 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e8e22bc5-4b3f-48db-86a6-02746aecf6b7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:54.204676 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e8e22bc5-4b3f-48db-86a6-02746aecf6b7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:54.359116 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-e8e22bc5-4b3f-48db-86a6-02746aecf6b7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:54.368333 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-e8e22bc5-4b3f-48db-86a6-02746aecf6b7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1319 microversion: 2.1 time: 0.184673 Aug 26 11:07:54.369192 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 225/433] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:54 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:54.636671 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a7f95a50-58ff-4853-b45d-ddb872fb7e25 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:54.637291 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a7f95a50-58ff-4853-b45d-ddb872fb7e25 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:54.643893 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a7f95a50-58ff-4853-b45d-ddb872fb7e25 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:54.644372 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a7f95a50-58ff-4853-b45d-ddb872fb7e25 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:54.644806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a7f95a50-58ff-4853-b45d-ddb872fb7e25 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:54.646320 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a7f95a50-58ff-4853-b45d-ddb872fb7e25 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:54.646779 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a7f95a50-58ff-4853-b45d-ddb872fb7e25 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:54.647203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a7f95a50-58ff-4853-b45d-ddb872fb7e25 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:54.806506 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a7f95a50-58ff-4853-b45d-ddb872fb7e25 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:54.822246 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a7f95a50-58ff-4853-b45d-ddb872fb7e25 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:54.823686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a7f95a50-58ff-4853-b45d-ddb872fb7e25 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:54.825006 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a7f95a50-58ff-4853-b45d-ddb872fb7e25 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.192173 Aug 26 11:07:54.825653 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 209/434] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:54 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:55.391096 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-6ff2a54b-f702-4c06-a648-ffb6f49e4665 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:55.391713 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-6ff2a54b-f702-4c06-a648-ffb6f49e4665 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:55.399547 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6ff2a54b-f702-4c06-a648-ffb6f49e4665 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:55.400041 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6ff2a54b-f702-4c06-a648-ffb6f49e4665 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:55.400480 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6ff2a54b-f702-4c06-a648-ffb6f49e4665 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:55.401193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6ff2a54b-f702-4c06-a648-ffb6f49e4665 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:55.401643 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6ff2a54b-f702-4c06-a648-ffb6f49e4665 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:55.402096 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6ff2a54b-f702-4c06-a648-ffb6f49e4665 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:55.557036 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6ff2a54b-f702-4c06-a648-ffb6f49e4665 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:55.570366 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-6ff2a54b-f702-4c06-a648-ffb6f49e4665 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1319 microversion: 2.1 time: 0.182964 Aug 26 11:07:55.571121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 226/435] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:55 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:07:55.639398 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-43225b68-94b7-4ebe-a54d-a1578301160b req-4e44e0bd-3b40-4006-a719-4bad4319a207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47cb1388-733b-490d-9c67-bee7fc7f5068", "name": "network-vif-plugged", "status": "completed", "tag": "886de8fb-f738-455e-92a7-cd1c58d3512d"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:55.649687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-43225b68-94b7-4ebe-a54d-a1578301160b req-4e44e0bd-3b40-4006-a719-4bad4319a207 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:55.650107 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-43225b68-94b7-4ebe-a54d-a1578301160b req-4e44e0bd-3b40-4006-a719-4bad4319a207 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:55.650535 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-43225b68-94b7-4ebe-a54d-a1578301160b req-4e44e0bd-3b40-4006-a719-4bad4319a207 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:55.662471 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-43225b68-94b7-4ebe-a54d-a1578301160b req-4e44e0bd-3b40-4006-a719-4bad4319a207 service nova] Creating event network-vif-plugged:886de8fb-f738-455e-92a7-cd1c58d3512d for instance 47cb1388-733b-490d-9c67-bee7fc7f5068 on hv-cinder-85236 Aug 26 11:07:55.667344 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-43225b68-94b7-4ebe-a54d-a1578301160b req-4e44e0bd-3b40-4006-a719-4bad4319a207 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031985 Aug 26 11:07:55.667928 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 210/436] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:07:55.849792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-22e60b16-96ac-4cd7-a0a8-aff7708a366d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:55.850443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-22e60b16-96ac-4cd7-a0a8-aff7708a366d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:55.859131 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22e60b16-96ac-4cd7-a0a8-aff7708a366d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:55.859659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22e60b16-96ac-4cd7-a0a8-aff7708a366d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:55.860078 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22e60b16-96ac-4cd7-a0a8-aff7708a366d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:55.860790 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22e60b16-96ac-4cd7-a0a8-aff7708a366d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:55.861243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22e60b16-96ac-4cd7-a0a8-aff7708a366d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:55.861669 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22e60b16-96ac-4cd7-a0a8-aff7708a366d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:56.023493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-22e60b16-96ac-4cd7-a0a8-aff7708a366d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:56.032238 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-22e60b16-96ac-4cd7-a0a8-aff7708a366d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:56.033694 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-22e60b16-96ac-4cd7-a0a8-aff7708a366d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:56.034913 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-22e60b16-96ac-4cd7-a0a8-aff7708a366d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1810 microversion: 2.20 time: 0.190245 Aug 26 11:07:56.035474 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 227/437] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:55 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:56.318602 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1b663ff1-2cc7-4185-be94-224f8cc08863 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb81a146-21da-456b-9b60-0ae882a14aec"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:07:56.321436 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1b663ff1-2cc7-4185-be94-224f8cc08863 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:56.328108 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1b663ff1-2cc7-4185-be94-224f8cc08863 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:56.328712 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1b663ff1-2cc7-4185-be94-224f8cc08863 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:56.329335 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1b663ff1-2cc7-4185-be94-224f8cc08863 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:56.330073 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1b663ff1-2cc7-4185-be94-224f8cc08863 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:56.330718 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1b663ff1-2cc7-4185-be94-224f8cc08863 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:56.331146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1b663ff1-2cc7-4185-be94-224f8cc08863 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:56.591824 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4f54336c-648b-4652-a04e-52a8712db4d9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:56.593155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4f54336c-648b-4652-a04e-52a8712db4d9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:56.600884 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f54336c-648b-4652-a04e-52a8712db4d9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:56.601451 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f54336c-648b-4652-a04e-52a8712db4d9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:56.601889 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f54336c-648b-4652-a04e-52a8712db4d9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:56.602643 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f54336c-648b-4652-a04e-52a8712db4d9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:56.603140 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f54336c-648b-4652-a04e-52a8712db4d9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:56.603630 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f54336c-648b-4652-a04e-52a8712db4d9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:56.773383 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4f54336c-648b-4652-a04e-52a8712db4d9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:56.782858 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4f54336c-648b-4652-a04e-52a8712db4d9 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1319 microversion: 2.1 time: 0.195021 Aug 26 11:07:56.783525 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 228/438] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:56 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:07:56.821015 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:07:56.831152 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1b663ff1-2cc7-4185-be94-224f8cc08863 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "POST /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.518151 Aug 26 11:07:56.831757 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 211/439] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 11:07:56 2022] POST /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments => generated 194 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:07:57.063928 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0952a158-10ed-4bb6-b889-c8876ed8373d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:57.064473 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0952a158-10ed-4bb6-b889-c8876ed8373d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:57.071331 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0952a158-10ed-4bb6-b889-c8876ed8373d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:57.071823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0952a158-10ed-4bb6-b889-c8876ed8373d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:57.072259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0952a158-10ed-4bb6-b889-c8876ed8373d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:57.072969 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0952a158-10ed-4bb6-b889-c8876ed8373d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:57.073454 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0952a158-10ed-4bb6-b889-c8876ed8373d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:57.073873 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0952a158-10ed-4bb6-b889-c8876ed8373d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:57.218876 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0952a158-10ed-4bb6-b889-c8876ed8373d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:57.229124 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0952a158-10ed-4bb6-b889-c8876ed8373d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:57.230595 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0952a158-10ed-4bb6-b889-c8876ed8373d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:57.231756 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0952a158-10ed-4bb6-b889-c8876ed8373d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1797 microversion: 2.20 time: 0.171918 Aug 26 11:07:57.232316 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 229/440] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:07:57 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1797 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:07:57.805014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-fa31083e-2e14-4090-9fa8-308c64b9de25 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:07:57.805865 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-fa31083e-2e14-4090-9fa8-308c64b9de25 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:07:57.812455 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fa31083e-2e14-4090-9fa8-308c64b9de25 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:57.812950 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fa31083e-2e14-4090-9fa8-308c64b9de25 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:57.813388 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fa31083e-2e14-4090-9fa8-308c64b9de25 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:57.814127 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fa31083e-2e14-4090-9fa8-308c64b9de25 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:07:57.814583 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fa31083e-2e14-4090-9fa8-308c64b9de25 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:07:57.815009 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fa31083e-2e14-4090-9fa8-308c64b9de25 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:07:57.970305 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-fa31083e-2e14-4090-9fa8-308c64b9de25 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:07:57.978848 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-fa31083e-2e14-4090-9fa8-308c64b9de25 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1507 microversion: 2.1 time: 0.179259 Aug 26 11:07:57.979414 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 212/441] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:07:57 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:05.518512 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-60f3e0d7-bda9-4118-9674-d62150e16350 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:08:05.520869 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-60f3e0d7-bda9-4118-9674-d62150e16350 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:05.523446 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=65 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:08:05.530641 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-60f3e0d7-bda9-4118-9674-d62150e16350 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:05.531165 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-60f3e0d7-bda9-4118-9674-d62150e16350 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:05.531602 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-60f3e0d7-bda9-4118-9674-d62150e16350 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:05.532306 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-60f3e0d7-bda9-4118-9674-d62150e16350 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:05.532765 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-60f3e0d7-bda9-4118-9674-d62150e16350 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:05.533185 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-60f3e0d7-bda9-4118-9674-d62150e16350 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:05.562752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-60f3e0d7-bda9-4118-9674-d62150e16350 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lazy-loading 'flavor' on Instance uuid 9530d01a-c2a4-44f2-a631-31faa3921205 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:08:05.724914 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-60f3e0d7-bda9-4118-9674-d62150e16350 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "POST /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/action" status: 200 len: 32 microversion: 2.1 time: 0.210742 Aug 26 11:08:05.725777 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 230/442] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 11:08:05 2022] POST /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 11:08:05.735254 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-afdd7734-58d6-4226-aa04-d70a11c2c259 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:05.736623 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-afdd7734-58d6-4226-aa04-d70a11c2c259 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:05.745345 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-afdd7734-58d6-4226-aa04-d70a11c2c259 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:05.746213 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-afdd7734-58d6-4226-aa04-d70a11c2c259 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:05.746876 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-afdd7734-58d6-4226-aa04-d70a11c2c259 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:05.747774 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-afdd7734-58d6-4226-aa04-d70a11c2c259 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:05.748316 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-afdd7734-58d6-4226-aa04-d70a11c2c259 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:05.749013 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-afdd7734-58d6-4226-aa04-d70a11c2c259 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:05.898005 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-afdd7734-58d6-4226-aa04-d70a11c2c259 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:05.912222 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-afdd7734-58d6-4226-aa04-d70a11c2c259 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.180810 Aug 26 11:08:05.913475 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 213/443] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:05 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:06.937844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b6b9b6ed-4494-40b7-ad5d-3c3ea3dd2c9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:06.939168 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b6b9b6ed-4494-40b7-ad5d-3c3ea3dd2c9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:06.948945 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6b9b6ed-4494-40b7-ad5d-3c3ea3dd2c9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:06.949442 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6b9b6ed-4494-40b7-ad5d-3c3ea3dd2c9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:06.949881 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6b9b6ed-4494-40b7-ad5d-3c3ea3dd2c9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:06.950633 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6b9b6ed-4494-40b7-ad5d-3c3ea3dd2c9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:06.951086 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6b9b6ed-4494-40b7-ad5d-3c3ea3dd2c9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:06.951513 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6b9b6ed-4494-40b7-ad5d-3c3ea3dd2c9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:07.102288 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b6b9b6ed-4494-40b7-ad5d-3c3ea3dd2c9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:07.105289 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:08:07.113536 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b6b9b6ed-4494-40b7-ad5d-3c3ea3dd2c9e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.182764 Aug 26 11:08:07.114147 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 231/444] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:06 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:07.276972 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-dbf9e6b1-ea04-4902-9652-5c368ef13f77 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:08:07.280128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-dbf9e6b1-ea04-4902-9652-5c368ef13f77 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:07.287093 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dbf9e6b1-ea04-4902-9652-5c368ef13f77 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:07.287581 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dbf9e6b1-ea04-4902-9652-5c368ef13f77 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:07.288015 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dbf9e6b1-ea04-4902-9652-5c368ef13f77 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:07.288767 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dbf9e6b1-ea04-4902-9652-5c368ef13f77 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:07.289217 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dbf9e6b1-ea04-4902-9652-5c368ef13f77 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:07.289756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dbf9e6b1-ea04-4902-9652-5c368ef13f77 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:07.368734 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-dbf9e6b1-ea04-4902-9652-5c368ef13f77 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "POST /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/action" status: 202 len: 0 microversion: 2.1 time: 0.096149 Aug 26 11:08:07.372765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 214/445] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 11:08:07 2022] POST /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:08:07.377847 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-351c08aa-156b-41f3-8821-5ea0980d0010 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:07.378504 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-351c08aa-156b-41f3-8821-5ea0980d0010 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:07.386465 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-351c08aa-156b-41f3-8821-5ea0980d0010 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:07.386972 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-351c08aa-156b-41f3-8821-5ea0980d0010 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:07.387401 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-351c08aa-156b-41f3-8821-5ea0980d0010 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:07.388116 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-351c08aa-156b-41f3-8821-5ea0980d0010 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:07.388574 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-351c08aa-156b-41f3-8821-5ea0980d0010 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:07.389003 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-351c08aa-156b-41f3-8821-5ea0980d0010 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:07.549533 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-351c08aa-156b-41f3-8821-5ea0980d0010 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:07.559286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-351c08aa-156b-41f3-8821-5ea0980d0010 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1747 microversion: 2.1 time: 0.185216 Aug 26 11:08:07.560679 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 232/446] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:07 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1747 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:08:08.137604 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b98555b2-7672-49a8-af28-133b18092b95 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:08.138465 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b98555b2-7672-49a8-af28-133b18092b95 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:08.145035 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b98555b2-7672-49a8-af28-133b18092b95 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:08.145521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b98555b2-7672-49a8-af28-133b18092b95 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:08.145952 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b98555b2-7672-49a8-af28-133b18092b95 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:08.146671 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b98555b2-7672-49a8-af28-133b18092b95 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:08.147118 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b98555b2-7672-49a8-af28-133b18092b95 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:08.147536 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b98555b2-7672-49a8-af28-133b18092b95 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:08.304317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b98555b2-7672-49a8-af28-133b18092b95 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:08.314439 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b98555b2-7672-49a8-af28-133b18092b95 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.182858 Aug 26 11:08:08.314996 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 215/447] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:08 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:08.585253 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3c9f07f4-3acf-4b02-bde4-7902d7b70c2c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:08.585815 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-3c9f07f4-3acf-4b02-bde4-7902d7b70c2c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:08.593266 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3c9f07f4-3acf-4b02-bde4-7902d7b70c2c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:08.593760 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3c9f07f4-3acf-4b02-bde4-7902d7b70c2c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:08.594241 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3c9f07f4-3acf-4b02-bde4-7902d7b70c2c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:08.594958 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3c9f07f4-3acf-4b02-bde4-7902d7b70c2c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:08.595528 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3c9f07f4-3acf-4b02-bde4-7902d7b70c2c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:08.595955 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3c9f07f4-3acf-4b02-bde4-7902d7b70c2c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:08.752193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-3c9f07f4-3acf-4b02-bde4-7902d7b70c2c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:08.761069 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-3c9f07f4-3acf-4b02-bde4-7902d7b70c2c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1752 microversion: 2.1 time: 0.180108 Aug 26 11:08:08.761657 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 233/448] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:08 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:09.336427 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-840208d6-5ace-4d17-a829-eee971b7089d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:09.337809 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-840208d6-5ace-4d17-a829-eee971b7089d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:09.344180 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-840208d6-5ace-4d17-a829-eee971b7089d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:09.344659 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-840208d6-5ace-4d17-a829-eee971b7089d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:09.345091 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-840208d6-5ace-4d17-a829-eee971b7089d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:09.345799 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-840208d6-5ace-4d17-a829-eee971b7089d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:09.346269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-840208d6-5ace-4d17-a829-eee971b7089d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:09.346686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-840208d6-5ace-4d17-a829-eee971b7089d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:09.484911 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-840208d6-5ace-4d17-a829-eee971b7089d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:09.494326 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-840208d6-5ace-4d17-a829-eee971b7089d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.161339 Aug 26 11:08:09.494912 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 216/449] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:09 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:09.785432 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-ac05f52f-6781-474c-abf6-6e039db584d3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:09.786065 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-ac05f52f-6781-474c-abf6-6e039db584d3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:09.793245 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ac05f52f-6781-474c-abf6-6e039db584d3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:09.793734 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ac05f52f-6781-474c-abf6-6e039db584d3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:09.794227 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ac05f52f-6781-474c-abf6-6e039db584d3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:09.794934 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ac05f52f-6781-474c-abf6-6e039db584d3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:09.795420 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ac05f52f-6781-474c-abf6-6e039db584d3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:09.795848 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ac05f52f-6781-474c-abf6-6e039db584d3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:09.949701 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-ac05f52f-6781-474c-abf6-6e039db584d3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:09.958228 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-ac05f52f-6781-474c-abf6-6e039db584d3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1752 microversion: 2.1 time: 0.176630 Aug 26 11:08:09.958806 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 234/450] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:09 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:10.515304 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e2f04c52-9b42-4585-9fac-2b88c20751b4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:10.515910 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e2f04c52-9b42-4585-9fac-2b88c20751b4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:10.522278 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e2f04c52-9b42-4585-9fac-2b88c20751b4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:10.522803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e2f04c52-9b42-4585-9fac-2b88c20751b4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:10.523196 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e2f04c52-9b42-4585-9fac-2b88c20751b4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:10.524534 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e2f04c52-9b42-4585-9fac-2b88c20751b4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:10.524977 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e2f04c52-9b42-4585-9fac-2b88c20751b4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:10.525401 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e2f04c52-9b42-4585-9fac-2b88c20751b4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:10.660992 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e2f04c52-9b42-4585-9fac-2b88c20751b4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:10.669782 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e2f04c52-9b42-4585-9fac-2b88c20751b4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.158332 Aug 26 11:08:10.670377 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 217/451] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:10 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:10.981990 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-fe54013e-7d2b-45f1-b0ec-6bb9d7f659aa tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:10.982717 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-fe54013e-7d2b-45f1-b0ec-6bb9d7f659aa tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:10.990258 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fe54013e-7d2b-45f1-b0ec-6bb9d7f659aa tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:10.990881 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fe54013e-7d2b-45f1-b0ec-6bb9d7f659aa tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:10.991311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fe54013e-7d2b-45f1-b0ec-6bb9d7f659aa tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:10.992008 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fe54013e-7d2b-45f1-b0ec-6bb9d7f659aa tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:10.992455 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fe54013e-7d2b-45f1-b0ec-6bb9d7f659aa tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:10.992955 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fe54013e-7d2b-45f1-b0ec-6bb9d7f659aa tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:11.145248 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-fe54013e-7d2b-45f1-b0ec-6bb9d7f659aa tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:11.154438 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-fe54013e-7d2b-45f1-b0ec-6bb9d7f659aa tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1752 microversion: 2.1 time: 0.177889 Aug 26 11:08:11.155043 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 235/452] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:10 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:11.691300 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7c3b4ac0-2847-4206-833b-591f2ecf1aec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:11.691843 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7c3b4ac0-2847-4206-833b-591f2ecf1aec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:11.699819 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7c3b4ac0-2847-4206-833b-591f2ecf1aec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:11.700305 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7c3b4ac0-2847-4206-833b-591f2ecf1aec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:11.700768 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7c3b4ac0-2847-4206-833b-591f2ecf1aec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:11.701586 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7c3b4ac0-2847-4206-833b-591f2ecf1aec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:11.701909 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7c3b4ac0-2847-4206-833b-591f2ecf1aec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:11.702356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7c3b4ac0-2847-4206-833b-591f2ecf1aec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:11.834473 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7c3b4ac0-2847-4206-833b-591f2ecf1aec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:11.842690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7c3b4ac0-2847-4206-833b-591f2ecf1aec tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.155366 Aug 26 11:08:11.843258 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 218/453] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:11 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:12.176888 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-2de22fff-945b-4672-9644-d919ffbaf2e9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:12.177509 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-2de22fff-945b-4672-9644-d919ffbaf2e9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:12.185042 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2de22fff-945b-4672-9644-d919ffbaf2e9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:12.185531 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2de22fff-945b-4672-9644-d919ffbaf2e9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:12.185996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2de22fff-945b-4672-9644-d919ffbaf2e9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:12.186708 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2de22fff-945b-4672-9644-d919ffbaf2e9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:12.187168 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2de22fff-945b-4672-9644-d919ffbaf2e9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:12.187593 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2de22fff-945b-4672-9644-d919ffbaf2e9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:12.357443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-2de22fff-945b-4672-9644-d919ffbaf2e9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:12.366067 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-2de22fff-945b-4672-9644-d919ffbaf2e9 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1752 microversion: 2.1 time: 0.193092 Aug 26 11:08:12.366636 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 236/454] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:12 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1752 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:12.863751 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-526b0cad-0760-41d5-94a8-747491b690f3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:12.864356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-526b0cad-0760-41d5-94a8-747491b690f3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:12.871794 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-526b0cad-0760-41d5-94a8-747491b690f3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:12.872278 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-526b0cad-0760-41d5-94a8-747491b690f3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:12.872716 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-526b0cad-0760-41d5-94a8-747491b690f3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:12.873408 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-526b0cad-0760-41d5-94a8-747491b690f3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:12.873858 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-526b0cad-0760-41d5-94a8-747491b690f3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:12.874310 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-526b0cad-0760-41d5-94a8-747491b690f3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:13.004017 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-526b0cad-0760-41d5-94a8-747491b690f3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:13.012429 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-526b0cad-0760-41d5-94a8-747491b690f3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.152576 Aug 26 11:08:13.012989 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 219/455] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:12 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:13.389651 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-31fef52d-f37a-4475-93d9-7e6176a0d02a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:13.390292 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-31fef52d-f37a-4475-93d9-7e6176a0d02a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:13.396778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-31fef52d-f37a-4475-93d9-7e6176a0d02a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:13.397268 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-31fef52d-f37a-4475-93d9-7e6176a0d02a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:13.397710 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-31fef52d-f37a-4475-93d9-7e6176a0d02a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:13.398436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-31fef52d-f37a-4475-93d9-7e6176a0d02a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:13.399706 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-31fef52d-f37a-4475-93d9-7e6176a0d02a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:13.400247 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-31fef52d-f37a-4475-93d9-7e6176a0d02a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:13.546709 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-31fef52d-f37a-4475-93d9-7e6176a0d02a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:13.555252 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-31fef52d-f37a-4475-93d9-7e6176a0d02a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1752 microversion: 2.1 time: 0.169414 Aug 26 11:08:13.556261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 237/456] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:13 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:08:14.033822 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9a91ab7c-97b9-423f-9d9b-d0febbb48055 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:14.034469 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9a91ab7c-97b9-423f-9d9b-d0febbb48055 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:14.036853 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=48 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:08:14.042532 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9a91ab7c-97b9-423f-9d9b-d0febbb48055 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:14.043020 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9a91ab7c-97b9-423f-9d9b-d0febbb48055 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:14.043459 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9a91ab7c-97b9-423f-9d9b-d0febbb48055 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:14.044159 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9a91ab7c-97b9-423f-9d9b-d0febbb48055 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:14.044616 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9a91ab7c-97b9-423f-9d9b-d0febbb48055 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:14.045043 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9a91ab7c-97b9-423f-9d9b-d0febbb48055 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:14.176141 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9a91ab7c-97b9-423f-9d9b-d0febbb48055 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:14.184808 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9a91ab7c-97b9-423f-9d9b-d0febbb48055 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.154874 Aug 26 11:08:14.185363 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 220/457] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:14 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:14.577111 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-cd29c9e0-d98b-4d53-8cb8-2a039d038d33 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:14.577723 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-cd29c9e0-d98b-4d53-8cb8-2a039d038d33 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:14.584089 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd29c9e0-d98b-4d53-8cb8-2a039d038d33 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:14.584569 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd29c9e0-d98b-4d53-8cb8-2a039d038d33 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:14.585004 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd29c9e0-d98b-4d53-8cb8-2a039d038d33 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:14.585696 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd29c9e0-d98b-4d53-8cb8-2a039d038d33 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:14.586216 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd29c9e0-d98b-4d53-8cb8-2a039d038d33 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:14.586626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd29c9e0-d98b-4d53-8cb8-2a039d038d33 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:14.729294 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-cd29c9e0-d98b-4d53-8cb8-2a039d038d33 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:14.737650 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-cd29c9e0-d98b-4d53-8cb8-2a039d038d33 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1752 microversion: 2.1 time: 0.164407 Aug 26 11:08:14.738255 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 238/458] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:14 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:15.206627 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9e5d2393-934e-4c81-bcd5-c5eedff1d077 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:15.207236 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9e5d2393-934e-4c81-bcd5-c5eedff1d077 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:15.214311 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e5d2393-934e-4c81-bcd5-c5eedff1d077 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:15.214793 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e5d2393-934e-4c81-bcd5-c5eedff1d077 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:15.215228 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e5d2393-934e-4c81-bcd5-c5eedff1d077 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:15.215918 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e5d2393-934e-4c81-bcd5-c5eedff1d077 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:15.216371 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e5d2393-934e-4c81-bcd5-c5eedff1d077 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:15.216796 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e5d2393-934e-4c81-bcd5-c5eedff1d077 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:15.358049 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9e5d2393-934e-4c81-bcd5-c5eedff1d077 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:15.366224 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9e5d2393-934e-4c81-bcd5-c5eedff1d077 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.163515 Aug 26 11:08:15.366788 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 221/459] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:15 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:15.760934 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-40d9c233-e7db-46c6-9917-5e7bacbee56b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:15.761545 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-40d9c233-e7db-46c6-9917-5e7bacbee56b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:15.768157 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-40d9c233-e7db-46c6-9917-5e7bacbee56b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:15.768639 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-40d9c233-e7db-46c6-9917-5e7bacbee56b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:15.769076 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-40d9c233-e7db-46c6-9917-5e7bacbee56b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:15.769766 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-40d9c233-e7db-46c6-9917-5e7bacbee56b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:15.770244 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-40d9c233-e7db-46c6-9917-5e7bacbee56b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:15.770665 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-40d9c233-e7db-46c6-9917-5e7bacbee56b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:15.915332 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-40d9c233-e7db-46c6-9917-5e7bacbee56b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:15.923688 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-40d9c233-e7db-46c6-9917-5e7bacbee56b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1752 microversion: 2.1 time: 0.167347 Aug 26 11:08:15.924255 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 239/460] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:15 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:16.388382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1f91c706-1275-495c-821b-19cc9ee6fcff tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:16.389018 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1f91c706-1275-495c-821b-19cc9ee6fcff tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:16.395702 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f91c706-1275-495c-821b-19cc9ee6fcff tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:16.396185 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f91c706-1275-495c-821b-19cc9ee6fcff tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:16.396616 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f91c706-1275-495c-821b-19cc9ee6fcff tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:16.397309 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f91c706-1275-495c-821b-19cc9ee6fcff tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:16.397771 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f91c706-1275-495c-821b-19cc9ee6fcff tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:16.398211 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f91c706-1275-495c-821b-19cc9ee6fcff tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:16.541832 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1f91c706-1275-495c-821b-19cc9ee6fcff tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:16.550366 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1f91c706-1275-495c-821b-19cc9ee6fcff tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.165770 Aug 26 11:08:16.550940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 222/461] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:16 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:16.945601 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-ed049e6e-c022-4b83-9bfd-6f636341e34b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:16.946690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-ed049e6e-c022-4b83-9bfd-6f636341e34b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:16.953532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ed049e6e-c022-4b83-9bfd-6f636341e34b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:16.954068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ed049e6e-c022-4b83-9bfd-6f636341e34b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:16.954580 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ed049e6e-c022-4b83-9bfd-6f636341e34b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:16.955587 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ed049e6e-c022-4b83-9bfd-6f636341e34b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:16.956076 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ed049e6e-c022-4b83-9bfd-6f636341e34b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:16.956457 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ed049e6e-c022-4b83-9bfd-6f636341e34b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:17.105342 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-ed049e6e-c022-4b83-9bfd-6f636341e34b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:17.114196 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-ed049e6e-c022-4b83-9bfd-6f636341e34b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1752 microversion: 2.1 time: 0.173232 Aug 26 11:08:17.114769 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 240/462] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:16 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:17.551249 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-514f771d-7a81-4ab5-86b3-49bb1c3a2f21 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c95bade4-5710-498c-a0e6-7d9468301eaa", "device": "/dev/sdb"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:08:17.554242 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-514f771d-7a81-4ab5-86b3-49bb1c3a2f21 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:17.561704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-514f771d-7a81-4ab5-86b3-49bb1c3a2f21 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:17.562234 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-514f771d-7a81-4ab5-86b3-49bb1c3a2f21 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:17.562672 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-514f771d-7a81-4ab5-86b3-49bb1c3a2f21 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:17.563375 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-514f771d-7a81-4ab5-86b3-49bb1c3a2f21 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:17.563833 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-514f771d-7a81-4ab5-86b3-49bb1c3a2f21 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:17.564254 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-514f771d-7a81-4ab5-86b3-49bb1c3a2f21 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:17.572471 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f8c0b05e-90fc-4828-8038-68d47a3dd5f5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:17.573186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f8c0b05e-90fc-4828-8038-68d47a3dd5f5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:17.579363 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f8c0b05e-90fc-4828-8038-68d47a3dd5f5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:17.579940 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f8c0b05e-90fc-4828-8038-68d47a3dd5f5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:17.580475 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f8c0b05e-90fc-4828-8038-68d47a3dd5f5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:17.581247 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f8c0b05e-90fc-4828-8038-68d47a3dd5f5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:17.581709 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f8c0b05e-90fc-4828-8038-68d47a3dd5f5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:17.582182 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f8c0b05e-90fc-4828-8038-68d47a3dd5f5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:17.724239 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f8c0b05e-90fc-4828-8038-68d47a3dd5f5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:17.733075 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f8c0b05e-90fc-4828-8038-68d47a3dd5f5 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.164887 Aug 26 11:08:17.733673 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 241/463] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:17 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:08:17.824035 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-514f771d-7a81-4ab5-86b3-49bb1c3a2f21 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "POST /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276716 Aug 26 11:08:17.824638 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 223/464] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 11:08:17 2022] POST /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:08:18.137608 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-96535be2-7afa-4da1-8035-72de38433f88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:18.138405 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-96535be2-7afa-4da1-8035-72de38433f88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:18.144870 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-96535be2-7afa-4da1-8035-72de38433f88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:18.145344 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-96535be2-7afa-4da1-8035-72de38433f88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:18.145775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-96535be2-7afa-4da1-8035-72de38433f88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:18.146510 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-96535be2-7afa-4da1-8035-72de38433f88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:18.146953 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-96535be2-7afa-4da1-8035-72de38433f88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:18.147377 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-96535be2-7afa-4da1-8035-72de38433f88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:18.299849 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-96535be2-7afa-4da1-8035-72de38433f88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:18.310090 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-96535be2-7afa-4da1-8035-72de38433f88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1752 microversion: 2.1 time: 0.177361 Aug 26 11:08:18.310673 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 242/465] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:18 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:18.756046 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-52251688-6492-4218-89a0-3e4e2a5573e3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:18.756652 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-52251688-6492-4218-89a0-3e4e2a5573e3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:18.764343 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52251688-6492-4218-89a0-3e4e2a5573e3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:18.764824 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52251688-6492-4218-89a0-3e4e2a5573e3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:18.765255 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52251688-6492-4218-89a0-3e4e2a5573e3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:18.765941 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52251688-6492-4218-89a0-3e4e2a5573e3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:18.766412 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52251688-6492-4218-89a0-3e4e2a5573e3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:18.766832 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52251688-6492-4218-89a0-3e4e2a5573e3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:18.909894 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-52251688-6492-4218-89a0-3e4e2a5573e3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:18.919555 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-52251688-6492-4218-89a0-3e4e2a5573e3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.167841 Aug 26 11:08:18.920137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 224/466] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:18 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:19.332353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-8d90f1c5-ad99-4c3b-bd67-46b57baa090a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:19.332965 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-8d90f1c5-ad99-4c3b-bd67-46b57baa090a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:19.340762 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8d90f1c5-ad99-4c3b-bd67-46b57baa090a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:19.341262 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8d90f1c5-ad99-4c3b-bd67-46b57baa090a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:19.342024 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8d90f1c5-ad99-4c3b-bd67-46b57baa090a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:19.342833 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8d90f1c5-ad99-4c3b-bd67-46b57baa090a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:19.343295 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8d90f1c5-ad99-4c3b-bd67-46b57baa090a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:19.343724 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8d90f1c5-ad99-4c3b-bd67-46b57baa090a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:19.495742 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8d90f1c5-ad99-4c3b-bd67-46b57baa090a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:19.504076 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-8d90f1c5-ad99-4c3b-bd67-46b57baa090a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1752 microversion: 2.1 time: 0.175673 Aug 26 11:08:19.504649 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 243/467] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:19 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:19.944332 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-655f8c17-0f77-4103-b85d-3bf477e6fac3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:19.945381 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-655f8c17-0f77-4103-b85d-3bf477e6fac3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:19.956825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-655f8c17-0f77-4103-b85d-3bf477e6fac3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:19.957644 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-655f8c17-0f77-4103-b85d-3bf477e6fac3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:19.958422 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-655f8c17-0f77-4103-b85d-3bf477e6fac3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:19.959622 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-655f8c17-0f77-4103-b85d-3bf477e6fac3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:19.960403 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-655f8c17-0f77-4103-b85d-3bf477e6fac3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:19.961160 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-655f8c17-0f77-4103-b85d-3bf477e6fac3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:20.142307 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-655f8c17-0f77-4103-b85d-3bf477e6fac3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:20.150654 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-655f8c17-0f77-4103-b85d-3bf477e6fac3 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.212751 Aug 26 11:08:20.151224 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 225/468] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:19 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:20.526118 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-464ed04b-d852-4170-9316-00e20dffdb86 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:20.526755 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-464ed04b-d852-4170-9316-00e20dffdb86 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:20.533147 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-464ed04b-d852-4170-9316-00e20dffdb86 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:20.533622 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-464ed04b-d852-4170-9316-00e20dffdb86 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:20.534080 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-464ed04b-d852-4170-9316-00e20dffdb86 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:20.534759 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-464ed04b-d852-4170-9316-00e20dffdb86 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:20.535203 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-464ed04b-d852-4170-9316-00e20dffdb86 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:20.535629 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-464ed04b-d852-4170-9316-00e20dffdb86 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:20.682426 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-464ed04b-d852-4170-9316-00e20dffdb86 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:20.690665 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-464ed04b-d852-4170-9316-00e20dffdb86 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1752 microversion: 2.1 time: 0.169056 Aug 26 11:08:20.691241 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 244/469] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:20 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:21.172573 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d6efa476-c90c-412e-ac14-85052e12cf36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:21.173115 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d6efa476-c90c-412e-ac14-85052e12cf36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:21.179750 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6efa476-c90c-412e-ac14-85052e12cf36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:21.180231 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6efa476-c90c-412e-ac14-85052e12cf36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:21.180668 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6efa476-c90c-412e-ac14-85052e12cf36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:21.181854 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6efa476-c90c-412e-ac14-85052e12cf36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:21.182347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6efa476-c90c-412e-ac14-85052e12cf36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:21.182771 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6efa476-c90c-412e-ac14-85052e12cf36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:21.185429 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:08:21.312910 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d6efa476-c90c-412e-ac14-85052e12cf36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:21.321105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d6efa476-c90c-412e-ac14-85052e12cf36 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.152514 Aug 26 11:08:21.321686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 226/470] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:21 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:21.713214 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b3e14889-5c51-47f2-91b2-a8c0abecafca tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:21.714052 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b3e14889-5c51-47f2-91b2-a8c0abecafca tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:21.720732 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b3e14889-5c51-47f2-91b2-a8c0abecafca tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:21.721221 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b3e14889-5c51-47f2-91b2-a8c0abecafca tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:21.721658 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b3e14889-5c51-47f2-91b2-a8c0abecafca tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:21.722401 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b3e14889-5c51-47f2-91b2-a8c0abecafca tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:21.722852 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b3e14889-5c51-47f2-91b2-a8c0abecafca tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:21.723277 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b3e14889-5c51-47f2-91b2-a8c0abecafca tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:21.885632 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b3e14889-5c51-47f2-91b2-a8c0abecafca tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:21.895353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b3e14889-5c51-47f2-91b2-a8c0abecafca tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1752 microversion: 2.1 time: 0.186072 Aug 26 11:08:21.895925 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 245/471] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:21 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:22.343772 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ac5a0891-e7fd-40bf-95ed-a92f1a224a06 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:22.344342 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ac5a0891-e7fd-40bf-95ed-a92f1a224a06 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:22.351477 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac5a0891-e7fd-40bf-95ed-a92f1a224a06 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:22.351982 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac5a0891-e7fd-40bf-95ed-a92f1a224a06 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:22.352427 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac5a0891-e7fd-40bf-95ed-a92f1a224a06 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:22.353150 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac5a0891-e7fd-40bf-95ed-a92f1a224a06 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:22.354250 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac5a0891-e7fd-40bf-95ed-a92f1a224a06 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:22.354712 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac5a0891-e7fd-40bf-95ed-a92f1a224a06 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:22.512915 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ac5a0891-e7fd-40bf-95ed-a92f1a224a06 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:22.516245 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ac5a0891-e7fd-40bf-95ed-a92f1a224a06 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.176421 Aug 26 11:08:22.516842 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 227/472] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:22 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:08:22.918455 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-fab9cf31-6e2b-4a40-8505-47f4bd60f560 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:22.919078 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-fab9cf31-6e2b-4a40-8505-47f4bd60f560 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:22.926061 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fab9cf31-6e2b-4a40-8505-47f4bd60f560 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:22.926551 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fab9cf31-6e2b-4a40-8505-47f4bd60f560 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:22.926984 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fab9cf31-6e2b-4a40-8505-47f4bd60f560 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:22.927691 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fab9cf31-6e2b-4a40-8505-47f4bd60f560 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:22.928144 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fab9cf31-6e2b-4a40-8505-47f4bd60f560 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:22.928575 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fab9cf31-6e2b-4a40-8505-47f4bd60f560 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:23.083269 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-fab9cf31-6e2b-4a40-8505-47f4bd60f560 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:23.092500 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-fab9cf31-6e2b-4a40-8505-47f4bd60f560 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1752 microversion: 2.1 time: 0.178900 Aug 26 11:08:23.093083 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 246/473] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:22 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:23.538914 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-91592a3d-7a12-4e9f-8eac-0f22feb7f9eb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:23.539517 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-91592a3d-7a12-4e9f-8eac-0f22feb7f9eb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:23.547583 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91592a3d-7a12-4e9f-8eac-0f22feb7f9eb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:23.548068 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91592a3d-7a12-4e9f-8eac-0f22feb7f9eb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:23.548499 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91592a3d-7a12-4e9f-8eac-0f22feb7f9eb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:23.549190 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91592a3d-7a12-4e9f-8eac-0f22feb7f9eb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:23.549930 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91592a3d-7a12-4e9f-8eac-0f22feb7f9eb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:23.550375 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91592a3d-7a12-4e9f-8eac-0f22feb7f9eb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:23.687853 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-91592a3d-7a12-4e9f-8eac-0f22feb7f9eb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:23.700015 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-91592a3d-7a12-4e9f-8eac-0f22feb7f9eb tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.164570 Aug 26 11:08:23.700955 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 228/474] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:23 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:24.113452 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3b1b3502-fa62-4118-abf1-11bae7b01fd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:24.113969 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-3b1b3502-fa62-4118-abf1-11bae7b01fd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:24.121281 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3b1b3502-fa62-4118-abf1-11bae7b01fd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:24.121759 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3b1b3502-fa62-4118-abf1-11bae7b01fd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:24.122233 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3b1b3502-fa62-4118-abf1-11bae7b01fd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:24.122914 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3b1b3502-fa62-4118-abf1-11bae7b01fd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:24.123359 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3b1b3502-fa62-4118-abf1-11bae7b01fd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:24.123774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3b1b3502-fa62-4118-abf1-11bae7b01fd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:24.276921 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-3b1b3502-fa62-4118-abf1-11bae7b01fd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:24.285712 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-3b1b3502-fa62-4118-abf1-11bae7b01fd3 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1752 microversion: 2.1 time: 0.176189 Aug 26 11:08:24.286402 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 247/475] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:24 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:24.722189 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-dd69e135-2aa6-4d6a-9bce-39fe06958460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:24.722732 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-dd69e135-2aa6-4d6a-9bce-39fe06958460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:24.729288 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd69e135-2aa6-4d6a-9bce-39fe06958460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:24.729768 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd69e135-2aa6-4d6a-9bce-39fe06958460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:24.730227 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd69e135-2aa6-4d6a-9bce-39fe06958460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:24.730914 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd69e135-2aa6-4d6a-9bce-39fe06958460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:24.731359 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd69e135-2aa6-4d6a-9bce-39fe06958460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:24.731776 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd69e135-2aa6-4d6a-9bce-39fe06958460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:24.867962 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-dd69e135-2aa6-4d6a-9bce-39fe06958460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:24.877718 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-dd69e135-2aa6-4d6a-9bce-39fe06958460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1732 microversion: 2.1 time: 0.159694 Aug 26 11:08:24.878319 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 229/476] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:24 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:25.308680 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-563aa216-7af4-46ee-b754-e4d05bc3e603 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:25.309336 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-563aa216-7af4-46ee-b754-e4d05bc3e603 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:25.316170 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-563aa216-7af4-46ee-b754-e4d05bc3e603 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:25.317245 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-563aa216-7af4-46ee-b754-e4d05bc3e603 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:25.318040 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-563aa216-7af4-46ee-b754-e4d05bc3e603 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:25.318995 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-563aa216-7af4-46ee-b754-e4d05bc3e603 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:25.319611 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-563aa216-7af4-46ee-b754-e4d05bc3e603 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:25.320042 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-563aa216-7af4-46ee-b754-e4d05bc3e603 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:25.344486 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=100 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:08:25.473761 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-563aa216-7af4-46ee-b754-e4d05bc3e603 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:25.483242 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-563aa216-7af4-46ee-b754-e4d05bc3e603 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1755 microversion: 2.1 time: 0.178839 Aug 26 11:08:25.483830 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 248/477] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:25 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:25.899994 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5f2f26c5-006f-40e3-80c6-acd4d8fb0dc1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:25.901180 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5f2f26c5-006f-40e3-80c6-acd4d8fb0dc1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:25.908967 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f2f26c5-006f-40e3-80c6-acd4d8fb0dc1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:25.909876 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f2f26c5-006f-40e3-80c6-acd4d8fb0dc1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:25.910344 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f2f26c5-006f-40e3-80c6-acd4d8fb0dc1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:25.911046 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f2f26c5-006f-40e3-80c6-acd4d8fb0dc1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:25.911501 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f2f26c5-006f-40e3-80c6-acd4d8fb0dc1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:25.911927 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f2f26c5-006f-40e3-80c6-acd4d8fb0dc1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:26.046053 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5f2f26c5-006f-40e3-80c6-acd4d8fb0dc1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:26.054070 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5f2f26c5-006f-40e3-80c6-acd4d8fb0dc1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1712 microversion: 2.1 time: 0.157954 Aug 26 11:08:26.054638 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 230/478] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:25 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1712 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:26.170942 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b68c2bea-911d-4c22-807e-25375eda9a52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:26.172550 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b68c2bea-911d-4c22-807e-25375eda9a52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:26.177193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b68c2bea-911d-4c22-807e-25375eda9a52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:26.177676 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b68c2bea-911d-4c22-807e-25375eda9a52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:26.178136 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b68c2bea-911d-4c22-807e-25375eda9a52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:26.178839 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b68c2bea-911d-4c22-807e-25375eda9a52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:26.179293 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b68c2bea-911d-4c22-807e-25375eda9a52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:26.179716 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b68c2bea-911d-4c22-807e-25375eda9a52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:26.309745 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-b68c2bea-911d-4c22-807e-25375eda9a52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] HTTP exception thrown: Cannot 'detach_volume' instance 9530d01a-c2a4-44f2-a631-31faa3921205 while it is in vm_state rescued Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b68c2bea-911d-4c22-807e-25375eda9a52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Request method failure captured: Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: DELETE /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments/eb81a146-21da-456b-9b60-0ae882a14aec HTTP/1.1 Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKjKoFWt_mGTxQc01qKCjXUDq7iYUfd7QeRZ0zpT5eoQIJBk_9LMauXMlsoKUf_7HcU9hxiDc2CZHgZUc6PoeUKDo4e4ygyUFdoUFueMawN06Zy51crBpM09ad2MKRCu2-vRhJQ6qXBCPYLTkAj0OO2mr6xCjOndICFG1gqY_Xj_h7k Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: 7db3b983562e49cfbb77c9e64b6e6cb9 Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-818754082 Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:08:26.311421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:08:26.312954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7db3b983562e49cfbb77c9e64b6e6cb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7db3b983562e49cfbb77c9e64b6e6cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7db3b983562e49cfbb77c9e64b6e6cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7db3b983562e49cfbb77c9e64b6e6cb9"}]}] Aug 26 11:08:26.312954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-ServerRescueNegativeTestJSON-818754082 Aug 26 11:08:26.312954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: 7db3b983562e49cfbb77c9e64b6e6cb9 Aug 26 11:08:26.312954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-818754082 Aug 26 11:08:26.312954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-ServerRescueNegativeTestJSON-818754082-project Aug 26 11:08:26.312954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:08:26.312954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:08:26.312954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: d6dbbabdd88c4c088bc91e6c43531318 Aug 26 11:08:26.312954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-ServerRescueNegativeTestJSON-818754082-project Aug 26 11:08:26.312954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:08:26.312954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Cannot 'detach_volume' instance 9530d01a-c2a4-44f2-a631-31faa3921205 while it is in vm_state rescued Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'server_id': '9530d01a-c2a4-44f2-a631-31faa3921205', 'id': 'eb81a146-21da-456b-9b60-0ae882a14aec'} Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9530d01a-c2a4-44f2-a631-31faa3921205 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:08:26.313690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:08:26.315435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 26 11:08:26.315435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 26 11:08:26.315435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 26 11:08:26.315435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 26 11:08:26.315435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9530d01a-c2a4-44f2-a631-31faa3921205 while it is in vm_state rescued Aug 26 11:08:26.315435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:08:26.315435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:08:26.315435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:08:26.315435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:08:26.315435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:08:26.315435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:08:26.315435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:08:26.315435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:08:26.315435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9530d01a-c2a4-44f2-a631-31faa3921205 while it is in vm_state rescued Aug 26 11:08:26.315435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:08:26.315435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b68c2bea-911d-4c22-807e-25375eda9a52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Returning 409 to user: Cannot 'detach_volume' instance 9530d01a-c2a4-44f2-a631-31faa3921205 while it is in vm_state rescued {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:08:26.316651 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b68c2bea-911d-4c22-807e-25375eda9a52 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments/eb81a146-21da-456b-9b60-0ae882a14aec" status: 409 len: 152 microversion: 2.1 time: 0.147017 Aug 26 11:08:26.316651 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 249/479] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 11:08:26 2022] DELETE /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments/eb81a146-21da-456b-9b60-0ae882a14aec => generated 152 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 26 11:08:26.322028 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5cd427d8-b36d-45db-bbe1-e6d7efc7556c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:08:26.322616 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5cd427d8-b36d-45db-bbe1-e6d7efc7556c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:26.330946 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cd427d8-b36d-45db-bbe1-e6d7efc7556c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:26.331444 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cd427d8-b36d-45db-bbe1-e6d7efc7556c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:26.331882 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cd427d8-b36d-45db-bbe1-e6d7efc7556c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:26.332590 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cd427d8-b36d-45db-bbe1-e6d7efc7556c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:26.333044 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cd427d8-b36d-45db-bbe1-e6d7efc7556c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:26.333474 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cd427d8-b36d-45db-bbe1-e6d7efc7556c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:26.413283 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5cd427d8-b36d-45db-bbe1-e6d7efc7556c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "POST /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/action" status: 202 len: 0 microversion: 2.1 time: 0.094942 Aug 26 11:08:26.414033 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 231/480] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 11:08:26 2022] POST /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:08:26.423061 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-e7b6017b-f12b-49a8-b19e-c1f74982ed2f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:26.423662 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e7b6017b-f12b-49a8-b19e-c1f74982ed2f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:26.431010 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e7b6017b-f12b-49a8-b19e-c1f74982ed2f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:26.431493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e7b6017b-f12b-49a8-b19e-c1f74982ed2f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:26.431925 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e7b6017b-f12b-49a8-b19e-c1f74982ed2f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:26.432621 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e7b6017b-f12b-49a8-b19e-c1f74982ed2f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:26.434168 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e7b6017b-f12b-49a8-b19e-c1f74982ed2f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:26.434615 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e7b6017b-f12b-49a8-b19e-c1f74982ed2f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:26.574352 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-e7b6017b-f12b-49a8-b19e-c1f74982ed2f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:26.583432 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-e7b6017b-f12b-49a8-b19e-c1f74982ed2f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1720 microversion: 2.1 time: 0.164287 Aug 26 11:08:26.583995 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 250/481] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:26 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:08:27.607430 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ffe58d67-aea0-40b7-b7fb-6f40641345df tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:27.608417 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ffe58d67-aea0-40b7-b7fb-6f40641345df tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:27.616171 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffe58d67-aea0-40b7-b7fb-6f40641345df tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:27.616668 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffe58d67-aea0-40b7-b7fb-6f40641345df tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:27.617110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffe58d67-aea0-40b7-b7fb-6f40641345df tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:27.617819 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffe58d67-aea0-40b7-b7fb-6f40641345df tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:27.618310 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffe58d67-aea0-40b7-b7fb-6f40641345df tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:27.618736 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffe58d67-aea0-40b7-b7fb-6f40641345df tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:27.783113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ffe58d67-aea0-40b7-b7fb-6f40641345df tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:27.792306 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ffe58d67-aea0-40b7-b7fb-6f40641345df tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1720 microversion: 2.1 time: 0.190746 Aug 26 11:08:27.792888 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 232/482] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:27 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1720 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:28.813722 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-6190ebd1-638b-4b9b-82f3-9843a52bdc23 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:28.814340 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-6190ebd1-638b-4b9b-82f3-9843a52bdc23 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:28.820842 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6190ebd1-638b-4b9b-82f3-9843a52bdc23 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:28.821304 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6190ebd1-638b-4b9b-82f3-9843a52bdc23 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:28.821743 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6190ebd1-638b-4b9b-82f3-9843a52bdc23 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:28.822489 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6190ebd1-638b-4b9b-82f3-9843a52bdc23 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:28.822949 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6190ebd1-638b-4b9b-82f3-9843a52bdc23 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:28.823439 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6190ebd1-638b-4b9b-82f3-9843a52bdc23 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:28.964627 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6190ebd1-638b-4b9b-82f3-9843a52bdc23 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:28.973058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-6190ebd1-638b-4b9b-82f3-9843a52bdc23 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1720 microversion: 2.1 time: 0.163191 Aug 26 11:08:28.973619 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 251/483] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:28 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:29.996648 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d9ec71be-0f4a-490c-97f4-59d45ec74288 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:29.997272 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d9ec71be-0f4a-490c-97f4-59d45ec74288 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:30.003875 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d9ec71be-0f4a-490c-97f4-59d45ec74288 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:30.004356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d9ec71be-0f4a-490c-97f4-59d45ec74288 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:30.004782 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d9ec71be-0f4a-490c-97f4-59d45ec74288 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:30.005765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d9ec71be-0f4a-490c-97f4-59d45ec74288 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:30.006245 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d9ec71be-0f4a-490c-97f4-59d45ec74288 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:30.006661 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d9ec71be-0f4a-490c-97f4-59d45ec74288 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:30.398070 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d9ec71be-0f4a-490c-97f4-59d45ec74288 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:30.407095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d9ec71be-0f4a-490c-97f4-59d45ec74288 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1720 microversion: 2.1 time: 0.415490 Aug 26 11:08:30.407671 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 233/484] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:29 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1720 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:31.430240 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-7dc1c50b-b4af-4301-b8a3-8390c278fbcd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:31.430872 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-7dc1c50b-b4af-4301-b8a3-8390c278fbcd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:31.438226 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7dc1c50b-b4af-4301-b8a3-8390c278fbcd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:31.438715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7dc1c50b-b4af-4301-b8a3-8390c278fbcd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:31.439153 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7dc1c50b-b4af-4301-b8a3-8390c278fbcd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:31.439854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7dc1c50b-b4af-4301-b8a3-8390c278fbcd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:31.440307 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7dc1c50b-b4af-4301-b8a3-8390c278fbcd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:31.440735 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7dc1c50b-b4af-4301-b8a3-8390c278fbcd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:31.578196 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7dc1c50b-b4af-4301-b8a3-8390c278fbcd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:31.586170 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-7dc1c50b-b4af-4301-b8a3-8390c278fbcd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1720 microversion: 2.1 time: 0.159917 Aug 26 11:08:31.586729 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 252/485] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:31 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:32.608326 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-bce4058c-50c2-4e94-911f-a519e7b593db tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:32.620047 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-bce4058c-50c2-4e94-911f-a519e7b593db tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:32.624387 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bce4058c-50c2-4e94-911f-a519e7b593db tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:32.624882 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bce4058c-50c2-4e94-911f-a519e7b593db tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:32.625322 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bce4058c-50c2-4e94-911f-a519e7b593db tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:32.626055 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bce4058c-50c2-4e94-911f-a519e7b593db tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:32.626514 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bce4058c-50c2-4e94-911f-a519e7b593db tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:32.626942 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bce4058c-50c2-4e94-911f-a519e7b593db tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:32.776875 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-bce4058c-50c2-4e94-911f-a519e7b593db tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:32.788081 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-bce4058c-50c2-4e94-911f-a519e7b593db tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1720 microversion: 2.1 time: 0.183803 Aug 26 11:08:32.788640 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 234/486] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:32 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:33.810604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0f720928-d552-4f18-a3d9-319564e562a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:33.811219 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0f720928-d552-4f18-a3d9-319564e562a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:33.817657 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f720928-d552-4f18-a3d9-319564e562a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:33.818184 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f720928-d552-4f18-a3d9-319564e562a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:33.818617 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f720928-d552-4f18-a3d9-319564e562a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:33.819303 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f720928-d552-4f18-a3d9-319564e562a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:33.819757 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f720928-d552-4f18-a3d9-319564e562a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:33.820178 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f720928-d552-4f18-a3d9-319564e562a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:33.948367 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0f720928-d552-4f18-a3d9-319564e562a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:33.956489 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0f720928-d552-4f18-a3d9-319564e562a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1720 microversion: 2.1 time: 0.150468 Aug 26 11:08:33.957054 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 253/487] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:33 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:34.978210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6a83f423-24dd-43b9-8601-7db0f84d9781 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:34.978837 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6a83f423-24dd-43b9-8601-7db0f84d9781 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:34.985401 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a83f423-24dd-43b9-8601-7db0f84d9781 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:34.985882 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a83f423-24dd-43b9-8601-7db0f84d9781 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:34.986345 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a83f423-24dd-43b9-8601-7db0f84d9781 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:34.987038 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a83f423-24dd-43b9-8601-7db0f84d9781 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:34.987490 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a83f423-24dd-43b9-8601-7db0f84d9781 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:34.987915 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a83f423-24dd-43b9-8601-7db0f84d9781 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:35.123332 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6a83f423-24dd-43b9-8601-7db0f84d9781 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:35.131765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6a83f423-24dd-43b9-8601-7db0f84d9781 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1720 microversion: 2.1 time: 0.157408 Aug 26 11:08:35.132340 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 235/488] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:34 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:36.154141 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-fae7b874-8c16-4ba4-ac5e-9ac6f3577efe tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:36.154936 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-fae7b874-8c16-4ba4-ac5e-9ac6f3577efe tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:36.156938 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=48 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:08:36.162125 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fae7b874-8c16-4ba4-ac5e-9ac6f3577efe tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:36.162616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fae7b874-8c16-4ba4-ac5e-9ac6f3577efe tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:36.163046 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fae7b874-8c16-4ba4-ac5e-9ac6f3577efe tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:36.163740 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fae7b874-8c16-4ba4-ac5e-9ac6f3577efe tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:36.164193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fae7b874-8c16-4ba4-ac5e-9ac6f3577efe tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:36.164613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fae7b874-8c16-4ba4-ac5e-9ac6f3577efe tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:36.307463 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-fae7b874-8c16-4ba4-ac5e-9ac6f3577efe tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:36.316081 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-fae7b874-8c16-4ba4-ac5e-9ac6f3577efe tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1720 microversion: 2.1 time: 0.166647 Aug 26 11:08:36.316674 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 254/489] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:36 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:37.338668 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b85ca099-689b-4d5e-ac8f-5b41c024e331 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:37.339281 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b85ca099-689b-4d5e-ac8f-5b41c024e331 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:37.347552 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b85ca099-689b-4d5e-ac8f-5b41c024e331 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:37.348038 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b85ca099-689b-4d5e-ac8f-5b41c024e331 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:37.348473 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b85ca099-689b-4d5e-ac8f-5b41c024e331 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:37.349173 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b85ca099-689b-4d5e-ac8f-5b41c024e331 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:37.349624 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b85ca099-689b-4d5e-ac8f-5b41c024e331 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:37.350076 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b85ca099-689b-4d5e-ac8f-5b41c024e331 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:37.499051 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b85ca099-689b-4d5e-ac8f-5b41c024e331 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:37.507441 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b85ca099-689b-4d5e-ac8f-5b41c024e331 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1726 microversion: 2.1 time: 0.173289 Aug 26 11:08:37.508017 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 236/490] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:37 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:37.528969 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a27f8b4d-3604-4ffa-8691-9f7250caa97f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:37.529502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-a27f8b4d-3604-4ffa-8691-9f7250caa97f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:37.535963 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a27f8b4d-3604-4ffa-8691-9f7250caa97f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:37.536442 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a27f8b4d-3604-4ffa-8691-9f7250caa97f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:37.536877 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a27f8b4d-3604-4ffa-8691-9f7250caa97f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:37.537565 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a27f8b4d-3604-4ffa-8691-9f7250caa97f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:37.538039 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a27f8b4d-3604-4ffa-8691-9f7250caa97f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:37.538464 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a27f8b4d-3604-4ffa-8691-9f7250caa97f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:37.618347 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-a27f8b4d-3604-4ffa-8691-9f7250caa97f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093660 Aug 26 11:08:37.618945 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 255/491] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 26 11:08:37 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:08:38.562428 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-6f66ed82-72c5-4f7a-aef1-8c72195fb627 req-1dc7560d-79ac-4a6c-a3ca-e5bef2995198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9530d01a-c2a4-44f2-a631-31faa3921205", "tag": "4641460f-7920-49e5-b889-55969872b7b8"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:08:38.576756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-6f66ed82-72c5-4f7a-aef1-8c72195fb627 req-1dc7560d-79ac-4a6c-a3ca-e5bef2995198 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:38.578648 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-6f66ed82-72c5-4f7a-aef1-8c72195fb627 req-1dc7560d-79ac-4a6c-a3ca-e5bef2995198 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:38.579352 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-6f66ed82-72c5-4f7a-aef1-8c72195fb627 req-1dc7560d-79ac-4a6c-a3ca-e5bef2995198 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:38.599077 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-6f66ed82-72c5-4f7a-aef1-8c72195fb627 req-1dc7560d-79ac-4a6c-a3ca-e5bef2995198 service nova] Creating event network-changed:4641460f-7920-49e5-b889-55969872b7b8 for instance 9530d01a-c2a4-44f2-a631-31faa3921205 on hv-cinder-85236 Aug 26 11:08:38.604304 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-6f66ed82-72c5-4f7a-aef1-8c72195fb627 req-1dc7560d-79ac-4a6c-a3ca-e5bef2995198 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048390 Aug 26 11:08:38.605340 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 237/492] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:08:40.621779 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-f17f5afa-a0a2-4ac5-bf41-7ed312abbbd7 req-a4f753e6-3ff7-432e-893c-5901f24cd14c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9530d01a-c2a4-44f2-a631-31faa3921205", "tag": "4641460f-7920-49e5-b889-55969872b7b8"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:08:40.631827 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f17f5afa-a0a2-4ac5-bf41-7ed312abbbd7 req-a4f753e6-3ff7-432e-893c-5901f24cd14c service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:40.632306 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f17f5afa-a0a2-4ac5-bf41-7ed312abbbd7 req-a4f753e6-3ff7-432e-893c-5901f24cd14c service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:40.632740 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f17f5afa-a0a2-4ac5-bf41-7ed312abbbd7 req-a4f753e6-3ff7-432e-893c-5901f24cd14c service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:40.643672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-f17f5afa-a0a2-4ac5-bf41-7ed312abbbd7 req-a4f753e6-3ff7-432e-893c-5901f24cd14c service nova] Creating event network-changed:4641460f-7920-49e5-b889-55969872b7b8 for instance 9530d01a-c2a4-44f2-a631-31faa3921205 on hv-cinder-85236 Aug 26 11:08:40.648799 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-f17f5afa-a0a2-4ac5-bf41-7ed312abbbd7 req-a4f753e6-3ff7-432e-893c-5901f24cd14c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031382 Aug 26 11:08:40.649333 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 256/493] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:08:44.861247 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d92ab672-8f4c-4779-b279-291244e263a4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:44.861833 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d92ab672-8f4c-4779-b279-291244e263a4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:44.863850 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=36 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:08:44.869243 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d92ab672-8f4c-4779-b279-291244e263a4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:44.870278 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d92ab672-8f4c-4779-b279-291244e263a4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:44.870450 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d92ab672-8f4c-4779-b279-291244e263a4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:44.871153 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d92ab672-8f4c-4779-b279-291244e263a4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:44.871605 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d92ab672-8f4c-4779-b279-291244e263a4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:44.872536 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d92ab672-8f4c-4779-b279-291244e263a4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:45.005795 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-d92ab672-8f4c-4779-b279-291244e263a4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lazy-loading 'services' on Instance uuid 47cb1388-733b-490d-9c67-bee7fc7f5068 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:08:45.129761 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d92ab672-8f4c-4779-b279-291244e263a4 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "DELETE /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068/os-volume_attachments/c95bade4-5710-498c-a0e6-7d9468301eaa" status: 202 len: 0 microversion: 2.1 time: 0.273099 Aug 26 11:08:45.131197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 238/494] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 11:08:44 2022] DELETE /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068/os-volume_attachments/c95bade4-5710-498c-a0e6-7d9468301eaa => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:08:47.326703 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-e3634fb7-8870-4542-938a-e264fc5e7b1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:47.327298 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e3634fb7-8870-4542-938a-e264fc5e7b1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:47.333289 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3634fb7-8870-4542-938a-e264fc5e7b1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:47.333759 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3634fb7-8870-4542-938a-e264fc5e7b1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:47.334213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3634fb7-8870-4542-938a-e264fc5e7b1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:47.334892 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3634fb7-8870-4542-938a-e264fc5e7b1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:47.335336 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3634fb7-8870-4542-938a-e264fc5e7b1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:47.335751 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3634fb7-8870-4542-938a-e264fc5e7b1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:47.360703 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e3634fb7-8870-4542-938a-e264fc5e7b1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Going to try to terminate instance {{(pid=120605) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:08:47.436274 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-e3634fb7-8870-4542-938a-e264fc5e7b1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "DELETE /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 204 len: 0 microversion: 2.1 time: 0.114584 Aug 26 11:08:47.436894 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 257/495] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:08:47 2022] DELETE /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:08:47.445652 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5a6479c9-98a6-4af7-acdb-d3d9667bdb34 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:47.446369 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5a6479c9-98a6-4af7-acdb-d3d9667bdb34 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:47.453606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a6479c9-98a6-4af7-acdb-d3d9667bdb34 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:47.454150 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a6479c9-98a6-4af7-acdb-d3d9667bdb34 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:47.454583 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a6479c9-98a6-4af7-acdb-d3d9667bdb34 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:47.455291 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a6479c9-98a6-4af7-acdb-d3d9667bdb34 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:47.455737 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a6479c9-98a6-4af7-acdb-d3d9667bdb34 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:47.456152 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a6479c9-98a6-4af7-acdb-d3d9667bdb34 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:47.591669 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5a6479c9-98a6-4af7-acdb-d3d9667bdb34 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:47.599643 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5a6479c9-98a6-4af7-acdb-d3d9667bdb34 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1513 microversion: 2.1 time: 0.158190 Aug 26 11:08:47.600221 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 239/496] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:47 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:48.621840 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-6ab2a425-42a6-4bcd-a391-94d0ca515631 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:48.622728 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-6ab2a425-42a6-4bcd-a391-94d0ca515631 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:48.628978 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6ab2a425-42a6-4bcd-a391-94d0ca515631 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:48.629461 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6ab2a425-42a6-4bcd-a391-94d0ca515631 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:48.629900 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6ab2a425-42a6-4bcd-a391-94d0ca515631 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:48.630625 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6ab2a425-42a6-4bcd-a391-94d0ca515631 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:48.631083 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6ab2a425-42a6-4bcd-a391-94d0ca515631 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:48.631510 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6ab2a425-42a6-4bcd-a391-94d0ca515631 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:48.768798 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6ab2a425-42a6-4bcd-a391-94d0ca515631 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:48.776436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-6ab2a425-42a6-4bcd-a391-94d0ca515631 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1513 microversion: 2.1 time: 0.159067 Aug 26 11:08:48.777000 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 258/497] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:48 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:49.798645 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-66d29ca7-cd53-45a0-8112-8c2bfe6473ec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:49.799255 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-66d29ca7-cd53-45a0-8112-8c2bfe6473ec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:49.805701 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66d29ca7-cd53-45a0-8112-8c2bfe6473ec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:49.806249 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66d29ca7-cd53-45a0-8112-8c2bfe6473ec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:49.806685 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66d29ca7-cd53-45a0-8112-8c2bfe6473ec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:49.807376 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66d29ca7-cd53-45a0-8112-8c2bfe6473ec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:49.807909 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66d29ca7-cd53-45a0-8112-8c2bfe6473ec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:49.808335 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66d29ca7-cd53-45a0-8112-8c2bfe6473ec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:49.938803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-66d29ca7-cd53-45a0-8112-8c2bfe6473ec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:49.946557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-66d29ca7-cd53-45a0-8112-8c2bfe6473ec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1513 microversion: 2.1 time: 0.152619 Aug 26 11:08:49.947122 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 240/498] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:49 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:08:50.427692 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-4c004c06-32e7-4db6-8bec-75581f8151e4 req-c076a606-ca12-45bf-bed5-f1c7f08fdcd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47cb1388-733b-490d-9c67-bee7fc7f5068", "name": "network-vif-deleted", "tag": "886de8fb-f738-455e-92a7-cd1c58d3512d"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:08:50.440523 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-4c004c06-32e7-4db6-8bec-75581f8151e4 req-c076a606-ca12-45bf-bed5-f1c7f08fdcd2 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:50.441028 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-4c004c06-32e7-4db6-8bec-75581f8151e4 req-c076a606-ca12-45bf-bed5-f1c7f08fdcd2 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:50.441681 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-4c004c06-32e7-4db6-8bec-75581f8151e4 req-c076a606-ca12-45bf-bed5-f1c7f08fdcd2 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:50.453609 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-4c004c06-32e7-4db6-8bec-75581f8151e4 req-c076a606-ca12-45bf-bed5-f1c7f08fdcd2 service nova] Creating event network-vif-deleted:886de8fb-f738-455e-92a7-cd1c58d3512d for instance 47cb1388-733b-490d-9c67-bee7fc7f5068 on hv-cinder-85236 Aug 26 11:08:50.459223 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-4c004c06-32e7-4db6-8bec-75581f8151e4 req-c076a606-ca12-45bf-bed5-f1c7f08fdcd2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035495 Aug 26 11:08:50.459814 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 259/499] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:08:50.967135 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5a9ac3c4-fd7f-4063-a381-d597a1c241f2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:50.967645 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5a9ac3c4-fd7f-4063-a381-d597a1c241f2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:50.974477 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a9ac3c4-fd7f-4063-a381-d597a1c241f2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:50.974963 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a9ac3c4-fd7f-4063-a381-d597a1c241f2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:50.975402 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a9ac3c4-fd7f-4063-a381-d597a1c241f2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:50.976097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a9ac3c4-fd7f-4063-a381-d597a1c241f2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:50.976552 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a9ac3c4-fd7f-4063-a381-d597a1c241f2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:50.976976 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a9ac3c4-fd7f-4063-a381-d597a1c241f2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:51.008852 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a9ac3c4-fd7f-4063-a381-d597a1c241f2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:51.009332 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a9ac3c4-fd7f-4063-a381-d597a1c241f2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:51.009768 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a9ac3c4-fd7f-4063-a381-d597a1c241f2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:51.010244 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-5a9ac3c4-fd7f-4063-a381-d597a1c241f2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lazy-loading 'fault' on Instance uuid 47cb1388-733b-490d-9c67-bee7fc7f5068 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:08:51.016560 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:08:51.059843 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5a9ac3c4-fd7f-4063-a381-d597a1c241f2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:08:51.068563 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5a9ac3c4-fd7f-4063-a381-d597a1c241f2 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 200 len: 1309 microversion: 2.1 time: 0.105398 Aug 26 11:08:51.069124 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 241/500] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:50 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:08:52.091048 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0bad2c9e-e0dd-4616-9189-46b51cd63e54 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:52.091694 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0bad2c9e-e0dd-4616-9189-46b51cd63e54 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: 47cb1388-733b-490d-9c67-bee7fc7f5068] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:52.098315 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0bad2c9e-e0dd-4616-9189-46b51cd63e54 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:52.098799 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0bad2c9e-e0dd-4616-9189-46b51cd63e54 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:52.099231 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0bad2c9e-e0dd-4616-9189-46b51cd63e54 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:52.099919 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0bad2c9e-e0dd-4616-9189-46b51cd63e54 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:52.100368 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0bad2c9e-e0dd-4616-9189-46b51cd63e54 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:52.100791 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0bad2c9e-e0dd-4616-9189-46b51cd63e54 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:52.114489 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-0bad2c9e-e0dd-4616-9189-46b51cd63e54 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] HTTP exception thrown: Instance 47cb1388-733b-490d-9c67-bee7fc7f5068 could not be found. Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0bad2c9e-e0dd-4616-9189-46b51cd63e54 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Request method failure captured: Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 HTTP/1.1 Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKlxj7UC9JiA9F40iIbwE4_82Z5j01zJYGBHYiJW7r1QrRrgPYcrU_ToTZ0sXbZ4YNmuEzaQ8nrCGFnw6seCacmjkEL-Zjx5H_h41LvnMmPP_WM8Z5vbwQWPFxUY63R2o6jaR31dPVsIKDfRIyOXLs6quqBlFJ2r6E8uAVGAs91Y1f0 Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: de754769f766487e859de1729e9d7a77 Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-VolumesSnapshotTestJSON-898562999 Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:08:52.116243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:08:52.117775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_de754769f766487e859de1729e9d7a77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/de754769f766487e859de1729e9d7a77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/de754769f766487e859de1729e9d7a77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/de754769f766487e859de1729e9d7a77"}]}] Aug 26 11:08:52.117775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-VolumesSnapshotTestJSON-898562999 Aug 26 11:08:52.117775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: de754769f766487e859de1729e9d7a77 Aug 26 11:08:52.117775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-898562999 Aug 26 11:08:52.117775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-VolumesSnapshotTestJSON-898562999-project Aug 26 11:08:52.117775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:08:52.117775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:08:52.117775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: c3aaf776da3a4bb0853946c195112f40 Aug 26 11:08:52.117775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-VolumesSnapshotTestJSON-898562999-project Aug 26 11:08:52.117775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:08:52.117775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance 47cb1388-733b-490d-9c67-bee7fc7f5068 could not be found. Aug 26 11:08:52.117775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': '47cb1388-733b-490d-9c67-bee7fc7f5068'} Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47cb1388-733b-490d-9c67-bee7fc7f5068 could not be found. Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:08:52.118811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47cb1388-733b-490d-9c67-bee7fc7f5068 could not be found. Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47cb1388-733b-490d-9c67-bee7fc7f5068 could not be found. Aug 26 11:08:52.120552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:08:52.122215 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0bad2c9e-e0dd-4616-9189-46b51cd63e54 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Returning 404 to user: Instance 47cb1388-733b-490d-9c67-bee7fc7f5068 could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:08:52.122215 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0bad2c9e-e0dd-4616-9189-46b51cd63e54 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068" status: 404 len: 111 microversion: 2.1 time: 0.030937 Aug 26 11:08:52.122215 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 260/501] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:08:52 2022] GET /compute/v2.1/servers/47cb1388-733b-490d-9c67-bee7fc7f5068 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:08:59.906014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a8bde264-14df-4959-8c43-a474b54b50f1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:59.907386 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a8bde264-14df-4959-8c43-a474b54b50f1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:59.915865 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8bde264-14df-4959-8c43-a474b54b50f1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:59.916394 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8bde264-14df-4959-8c43-a474b54b50f1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:59.917107 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8bde264-14df-4959-8c43-a474b54b50f1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:59.921070 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8bde264-14df-4959-8c43-a474b54b50f1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:59.921070 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8bde264-14df-4959-8c43-a474b54b50f1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:59.921070 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8bde264-14df-4959-8c43-a474b54b50f1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:59.930625 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b2422e70-5036-45a1-ba9f-79eeb912e58f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:08:59.931559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b2422e70-5036-45a1-ba9f-79eeb912e58f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:08:59.941005 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2422e70-5036-45a1-ba9f-79eeb912e58f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:59.941600 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2422e70-5036-45a1-ba9f-79eeb912e58f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:59.942340 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2422e70-5036-45a1-ba9f-79eeb912e58f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:59.942796 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2422e70-5036-45a1-ba9f-79eeb912e58f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:08:59.943645 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2422e70-5036-45a1-ba9f-79eeb912e58f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:08:59.944071 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b2422e70-5036-45a1-ba9f-79eeb912e58f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:08:59.947128 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:08:59.963667 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a8bde264-14df-4959-8c43-a474b54b50f1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/os-volume_attachments/70598002-b341-4079-a5f1-ee57cf444374" status: 200 len: 194 microversion: 2.20 time: 0.063444 Aug 26 11:08:59.965383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 242/502] 10.222.0.40 () {60 vars in 1454 bytes} [Fri Aug 26 11:08:59 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/os-volume_attachments/70598002-b341-4079-a5f1-ee57cf444374 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 11:08:59.970955 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1654566303", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452", "networks": [{"uuid": "e5e46ef0-dbf5-44da-8924-d19e9ec8988c"}]}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:00.043650 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] validate_networks() for [('e5e46ef0-dbf5-44da-8924-d19e9ec8988c', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:09:00.072341 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-b2422e70-5036-45a1-ba9f-79eeb912e58f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lazy-loading 'services' on Instance uuid fcad555f-f60b-409e-9075-f4fcdbbba3fe {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:09:00.229562 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b2422e70-5036-45a1-ba9f-79eeb912e58f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/os-volume_attachments/4082c4b3-2f5f-4500-8047-1bac6e487c44" status: 202 len: 0 microversion: 2.1 time: 0.305775 Aug 26 11:09:00.230561 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 261/503] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 11:08:59 2022] DELETE /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/os-volume_attachments/4082c4b3-2f5f-4500-8047-1bac6e487c44 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:09:00.237376 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-622fd934-af1b-4e4e-b998-db1c170efedf tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:00.237999 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-622fd934-af1b-4e4e-b998-db1c170efedf tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:00.245351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-622fd934-af1b-4e4e-b998-db1c170efedf tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:00.245843 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-622fd934-af1b-4e4e-b998-db1c170efedf tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:00.246332 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-622fd934-af1b-4e4e-b998-db1c170efedf tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:00.247046 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-622fd934-af1b-4e4e-b998-db1c170efedf tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:00.247490 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-622fd934-af1b-4e4e-b998-db1c170efedf tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:00.248335 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-622fd934-af1b-4e4e-b998-db1c170efedf tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:00.373415 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-622fd934-af1b-4e4e-b998-db1c170efedf tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lazy-loading 'services' on Instance uuid 01ae91d9-0521-4d14-b2b6-e56f249c4181 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:09:00.468164 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-622fd934-af1b-4e4e-b998-db1c170efedf tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "DELETE /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/os-volume_attachments/70598002-b341-4079-a5f1-ee57cf444374" status: 202 len: 0 microversion: 2.20 time: 0.235864 Aug 26 11:09:00.468764 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 262/504] 10.222.0.40 () {60 vars in 1457 bytes} [Fri Aug 26 11:09:00 2022] DELETE /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/os-volume_attachments/70598002-b341-4079-a5f1-ee57cf444374 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:09:00.479099 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0d8dd227-23b1-4f9a-af34-b0aad2e1fcee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:00.481507 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0d8dd227-23b1-4f9a-af34-b0aad2e1fcee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:00.488539 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0d8dd227-23b1-4f9a-af34-b0aad2e1fcee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:00.489038 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0d8dd227-23b1-4f9a-af34-b0aad2e1fcee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:00.489481 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0d8dd227-23b1-4f9a-af34-b0aad2e1fcee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:00.490225 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0d8dd227-23b1-4f9a-af34-b0aad2e1fcee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:00.490682 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0d8dd227-23b1-4f9a-af34-b0aad2e1fcee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:00.491105 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0d8dd227-23b1-4f9a-af34-b0aad2e1fcee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:00.530021 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0d8dd227-23b1-4f9a-af34-b0aad2e1fcee tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055135 Aug 26 11:09:00.530631 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 263/505] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 26 11:09:00 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 11:09:00.546754 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:09:00.547778 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:09:00.548433 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:09:00.548859 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:09:00.549087 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:09:00.559528 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:00.560047 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:00.560555 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:00.561314 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:00.561811 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:00.562310 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:00.582589 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Getting quotas for project de754769f766487e859de1729e9d7a77. Resources: {'instances', 'ram', 'cores'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:09:00.586689 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Getting quotas for user c3aaf776da3a4bb0853946c195112f40 and project de754769f766487e859de1729e9d7a77. Resources: {'instances', 'ram', 'cores'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:09:00.598529 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:09:00.600917 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:09:00.648627 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1d33383c-bf68-44cd-a61f-1a6e1c4852d3 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683240 Aug 26 11:09:00.649272 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 243/506] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:08:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:09:00.660838 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-18c40c9b-9aab-42c1-9bd1-01f8436ac287 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:00.661446 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-18c40c9b-9aab-42c1-9bd1-01f8436ac287 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:00.723787 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-18c40c9b-9aab-42c1-9bd1-01f8436ac287 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:00.737476 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-18c40c9b-9aab-42c1-9bd1-01f8436ac287 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1219 microversion: 2.1 time: 0.080772 Aug 26 11:09:00.738371 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 264/507] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:00 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:01.407349 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b9c691e0-5968-43a6-b790-faf4b541133a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:01.418185 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b9c691e0-5968-43a6-b790-faf4b541133a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:01.419032 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b9c691e0-5968-43a6-b790-faf4b541133a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:01.419825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b9c691e0-5968-43a6-b790-faf4b541133a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:01.447608 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b9c691e0-5968-43a6-b790-faf4b541133a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Going to try to stop instance {{(pid=120604) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 26 11:09:01.502756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b9c691e0-5968-43a6-b790-faf4b541133a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "POST /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.101365 Aug 26 11:09:01.503505 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 244/508] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 11:09:01 2022] POST /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 11:09:01.513184 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-382d52ed-4172-4696-a595-a308f07c3146 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:01.514025 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-382d52ed-4172-4696-a595-a308f07c3146 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:01.522998 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-382d52ed-4172-4696-a595-a308f07c3146 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:01.523632 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-382d52ed-4172-4696-a595-a308f07c3146 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:01.526182 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-382d52ed-4172-4696-a595-a308f07c3146 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:01.526182 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-382d52ed-4172-4696-a595-a308f07c3146 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:01.526694 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-382d52ed-4172-4696-a595-a308f07c3146 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:01.527259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-382d52ed-4172-4696-a595-a308f07c3146 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:01.551617 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-55d01b60-c4f9-4a88-a7bf-3817a98f9b3e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:01.554210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-55d01b60-c4f9-4a88-a7bf-3817a98f9b3e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:01.560834 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55d01b60-c4f9-4a88-a7bf-3817a98f9b3e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:01.561374 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55d01b60-c4f9-4a88-a7bf-3817a98f9b3e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:01.561802 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55d01b60-c4f9-4a88-a7bf-3817a98f9b3e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:01.562534 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55d01b60-c4f9-4a88-a7bf-3817a98f9b3e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:01.563058 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55d01b60-c4f9-4a88-a7bf-3817a98f9b3e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:01.563850 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55d01b60-c4f9-4a88-a7bf-3817a98f9b3e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:01.615092 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-55d01b60-c4f9-4a88-a7bf-3817a98f9b3e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072851 Aug 26 11:09:01.615560 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 245/509] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 26 11:09:01 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 11:09:01.757232 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-382d52ed-4172-4696-a595-a308f07c3146 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:01.774862 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-382d52ed-4172-4696-a595-a308f07c3146 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1677 microversion: 2.1 time: 0.265628 Aug 26 11:09:01.781195 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7d7bf3f7-b3ef-4b8a-8c4c-dbfb55d3ce67 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:01.783374 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7d7bf3f7-b3ef-4b8a-8c4c-dbfb55d3ce67 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:01.791562 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 265/510] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:01 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1677 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:01.800953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d7bf3f7-b3ef-4b8a-8c4c-dbfb55d3ce67 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:01.802137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d7bf3f7-b3ef-4b8a-8c4c-dbfb55d3ce67 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:01.802893 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d7bf3f7-b3ef-4b8a-8c4c-dbfb55d3ce67 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:01.803956 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d7bf3f7-b3ef-4b8a-8c4c-dbfb55d3ce67 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:01.805094 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d7bf3f7-b3ef-4b8a-8c4c-dbfb55d3ce67 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:01.806077 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d7bf3f7-b3ef-4b8a-8c4c-dbfb55d3ce67 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:01.905439 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7d7bf3f7-b3ef-4b8a-8c4c-dbfb55d3ce67 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:01.919433 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7d7bf3f7-b3ef-4b8a-8c4c-dbfb55d3ce67 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1215 microversion: 2.1 time: 0.144396 Aug 26 11:09:01.920860 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 246/511] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:01 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1215 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:02.628675 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3e2e4e71-db56-4bc7-ae16-8fab7ec6c1dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:02.630957 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-3e2e4e71-db56-4bc7-ae16-8fab7ec6c1dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:02.637405 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3e2e4e71-db56-4bc7-ae16-8fab7ec6c1dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:02.637880 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3e2e4e71-db56-4bc7-ae16-8fab7ec6c1dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:02.638353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3e2e4e71-db56-4bc7-ae16-8fab7ec6c1dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:02.639101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3e2e4e71-db56-4bc7-ae16-8fab7ec6c1dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:02.639647 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3e2e4e71-db56-4bc7-ae16-8fab7ec6c1dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:02.639972 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3e2e4e71-db56-4bc7-ae16-8fab7ec6c1dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:02.680549 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-3e2e4e71-db56-4bc7-ae16-8fab7ec6c1dc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056637 Aug 26 11:09:02.681579 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 266/512] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 26 11:09:02 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 11:09:02.817364 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-71d649bb-e45e-4edb-90ed-069cff44e9ad tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:02.818327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-71d649bb-e45e-4edb-90ed-069cff44e9ad tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:02.825231 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71d649bb-e45e-4edb-90ed-069cff44e9ad tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:02.826480 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71d649bb-e45e-4edb-90ed-069cff44e9ad tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:02.827320 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71d649bb-e45e-4edb-90ed-069cff44e9ad tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:02.829111 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71d649bb-e45e-4edb-90ed-069cff44e9ad tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:02.830272 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71d649bb-e45e-4edb-90ed-069cff44e9ad tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:02.830719 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71d649bb-e45e-4edb-90ed-069cff44e9ad tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:02.950807 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-17568ec1-723b-427f-850f-5549a5a95eae tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:02.951572 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-17568ec1-723b-427f-850f-5549a5a95eae tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:02.958572 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-17568ec1-723b-427f-850f-5549a5a95eae tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:02.959463 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-17568ec1-723b-427f-850f-5549a5a95eae tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:02.960128 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-17568ec1-723b-427f-850f-5549a5a95eae tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:02.961216 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-17568ec1-723b-427f-850f-5549a5a95eae tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:02.961886 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-17568ec1-723b-427f-850f-5549a5a95eae tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:02.962604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-17568ec1-723b-427f-850f-5549a5a95eae tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:03.011621 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-71d649bb-e45e-4edb-90ed-069cff44e9ad tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:03.023923 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-71d649bb-e45e-4edb-90ed-069cff44e9ad tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1677 microversion: 2.1 time: 0.212734 Aug 26 11:09:03.030523 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 247/513] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:02 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1677 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:03.047393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-17568ec1-723b-427f-850f-5549a5a95eae tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:03.055625 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-17568ec1-723b-427f-850f-5549a5a95eae tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1277 microversion: 2.1 time: 0.109021 Aug 26 11:09:03.056209 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 267/514] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:02 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:03.701360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c7791997-fb36-4e52-80c5-996108199c77 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:03.705658 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c7791997-fb36-4e52-80c5-996108199c77 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:03.715769 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c7791997-fb36-4e52-80c5-996108199c77 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:03.716268 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c7791997-fb36-4e52-80c5-996108199c77 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:03.716714 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c7791997-fb36-4e52-80c5-996108199c77 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:03.717455 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c7791997-fb36-4e52-80c5-996108199c77 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:03.717894 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c7791997-fb36-4e52-80c5-996108199c77 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:03.718352 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c7791997-fb36-4e52-80c5-996108199c77 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:03.756138 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c7791997-fb36-4e52-80c5-996108199c77 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062383 Aug 26 11:09:03.756728 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 248/515] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 26 11:09:03 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:03.824458 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3698a6b4-5f1c-43e3-b43e-0b391d5a5be8 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:03.825866 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-3698a6b4-5f1c-43e3-b43e-0b391d5a5be8 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:03.833439 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3698a6b4-5f1c-43e3-b43e-0b391d5a5be8 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:03.833933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3698a6b4-5f1c-43e3-b43e-0b391d5a5be8 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:03.834424 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3698a6b4-5f1c-43e3-b43e-0b391d5a5be8 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:03.835500 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3698a6b4-5f1c-43e3-b43e-0b391d5a5be8 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:03.836058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3698a6b4-5f1c-43e3-b43e-0b391d5a5be8 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:03.836513 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3698a6b4-5f1c-43e3-b43e-0b391d5a5be8 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:03.873239 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-3698a6b4-5f1c-43e3-b43e-0b391d5a5be8 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Going to try to terminate instance {{(pid=120605) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:09:03.961616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-3698a6b4-5f1c-43e3-b43e-0b391d5a5be8 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "DELETE /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 204 len: 0 microversion: 2.20 time: 0.140678 Aug 26 11:09:03.962280 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 268/516] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Aug 26 11:09:03 2022] DELETE /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 11:09:03.970997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-50015e7a-8ac7-4d06-9231-1d525c659450 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:03.973166 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-50015e7a-8ac7-4d06-9231-1d525c659450 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:03.980106 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-50015e7a-8ac7-4d06-9231-1d525c659450 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:03.980981 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-50015e7a-8ac7-4d06-9231-1d525c659450 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:03.981415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-50015e7a-8ac7-4d06-9231-1d525c659450 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:03.982175 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-50015e7a-8ac7-4d06-9231-1d525c659450 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:03.982626 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-50015e7a-8ac7-4d06-9231-1d525c659450 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:03.983046 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-50015e7a-8ac7-4d06-9231-1d525c659450 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:04.050008 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-596901d5-b3c8-4fa9-a820-4c3740c7450b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:04.050364 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-596901d5-b3c8-4fa9-a820-4c3740c7450b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:04.056681 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-596901d5-b3c8-4fa9-a820-4c3740c7450b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:04.057515 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-596901d5-b3c8-4fa9-a820-4c3740c7450b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:04.058084 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-596901d5-b3c8-4fa9-a820-4c3740c7450b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:04.059034 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-596901d5-b3c8-4fa9-a820-4c3740c7450b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:04.059362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-596901d5-b3c8-4fa9-a820-4c3740c7450b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:04.060029 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-596901d5-b3c8-4fa9-a820-4c3740c7450b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:04.207005 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-50015e7a-8ac7-4d06-9231-1d525c659450 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:04.215976 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-50015e7a-8ac7-4d06-9231-1d525c659450 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:04.217442 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-50015e7a-8ac7-4d06-9231-1d525c659450 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:04.218656 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-50015e7a-8ac7-4d06-9231-1d525c659450 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.251753 Aug 26 11:09:04.219259 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 249/517] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:03 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:09:04.225310 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7f53a24c-1cf9-48c3-9fa1-42d5cd15443f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:04.226219 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7f53a24c-1cf9-48c3-9fa1-42d5cd15443f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:04.232669 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f53a24c-1cf9-48c3-9fa1-42d5cd15443f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:04.233364 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f53a24c-1cf9-48c3-9fa1-42d5cd15443f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:04.234123 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f53a24c-1cf9-48c3-9fa1-42d5cd15443f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:04.235379 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f53a24c-1cf9-48c3-9fa1-42d5cd15443f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:04.236005 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f53a24c-1cf9-48c3-9fa1-42d5cd15443f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:04.236607 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f53a24c-1cf9-48c3-9fa1-42d5cd15443f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:04.293772 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-596901d5-b3c8-4fa9-a820-4c3740c7450b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:04.304044 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-596901d5-b3c8-4fa9-a820-4c3740c7450b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1677 microversion: 2.1 time: 0.261334 Aug 26 11:09:04.315731 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 269/518] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:04 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1677 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:04.315731 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-f8b71845-def6-4a92-ac78-05b9e6adba24 req-6dcbdcf0-7a23-4080-9385-30ec297986d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca6ba27-f52a-4bcb-9e67-d09645be0b19", "tag": "2088f2dc-209d-4e12-8ff3-5642dd1ed8b2"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:04.324555 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f8b71845-def6-4a92-ac78-05b9e6adba24 req-6dcbdcf0-7a23-4080-9385-30ec297986d2 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:04.325403 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f8b71845-def6-4a92-ac78-05b9e6adba24 req-6dcbdcf0-7a23-4080-9385-30ec297986d2 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:04.325914 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f8b71845-def6-4a92-ac78-05b9e6adba24 req-6dcbdcf0-7a23-4080-9385-30ec297986d2 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:04.348182 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-f8b71845-def6-4a92-ac78-05b9e6adba24 req-6dcbdcf0-7a23-4080-9385-30ec297986d2 service nova] Creating event network-changed:2088f2dc-209d-4e12-8ff3-5642dd1ed8b2 for instance aca6ba27-f52a-4bcb-9e67-d09645be0b19 on hv-cinder-85236 Aug 26 11:09:04.355058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-f8b71845-def6-4a92-ac78-05b9e6adba24 req-6dcbdcf0-7a23-4080-9385-30ec297986d2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048415 Aug 26 11:09:04.355825 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 270/519] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:09:04.416190 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7f53a24c-1cf9-48c3-9fa1-42d5cd15443f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:04.424872 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7f53a24c-1cf9-48c3-9fa1-42d5cd15443f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1319 microversion: 2.1 time: 0.204418 Aug 26 11:09:04.425439 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 250/520] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:04 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:05.245459 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-8cb42a24-29ad-460d-b0e7-c289d9497c48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:05.246253 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-8cb42a24-29ad-460d-b0e7-c289d9497c48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:05.252906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8cb42a24-29ad-460d-b0e7-c289d9497c48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:05.253859 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8cb42a24-29ad-460d-b0e7-c289d9497c48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:05.253859 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8cb42a24-29ad-460d-b0e7-c289d9497c48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:05.254534 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8cb42a24-29ad-460d-b0e7-c289d9497c48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:05.255015 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8cb42a24-29ad-460d-b0e7-c289d9497c48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:05.255437 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8cb42a24-29ad-460d-b0e7-c289d9497c48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:05.331587 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-195f4247-c945-4b44-be74-4fb190a79ae0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:05.332248 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-195f4247-c945-4b44-be74-4fb190a79ae0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:05.339248 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-195f4247-c945-4b44-be74-4fb190a79ae0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:05.339738 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-195f4247-c945-4b44-be74-4fb190a79ae0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:05.340169 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-195f4247-c945-4b44-be74-4fb190a79ae0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:05.340873 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-195f4247-c945-4b44-be74-4fb190a79ae0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:05.341321 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-195f4247-c945-4b44-be74-4fb190a79ae0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:05.341760 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-195f4247-c945-4b44-be74-4fb190a79ae0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:05.452727 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8cb42a24-29ad-460d-b0e7-c289d9497c48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:05.465925 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8cb42a24-29ad-460d-b0e7-c289d9497c48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:05.470780 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8cb42a24-29ad-460d-b0e7-c289d9497c48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:05.472160 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-8cb42a24-29ad-460d-b0e7-c289d9497c48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.231738 Aug 26 11:09:05.472850 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 271/521] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:05 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:09:05.477609 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-672c0bd1-93a4-4aea-814b-1ef4dba89a69 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:05.478826 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-672c0bd1-93a4-4aea-814b-1ef4dba89a69 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:05.487205 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-672c0bd1-93a4-4aea-814b-1ef4dba89a69 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:05.487753 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-672c0bd1-93a4-4aea-814b-1ef4dba89a69 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:05.488278 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-672c0bd1-93a4-4aea-814b-1ef4dba89a69 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:05.489045 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-672c0bd1-93a4-4aea-814b-1ef4dba89a69 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:05.489608 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-672c0bd1-93a4-4aea-814b-1ef4dba89a69 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:05.490058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-672c0bd1-93a4-4aea-814b-1ef4dba89a69 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:05.536120 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-195f4247-c945-4b44-be74-4fb190a79ae0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:05.545438 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-195f4247-c945-4b44-be74-4fb190a79ae0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1677 microversion: 2.1 time: 0.218417 Aug 26 11:09:05.546126 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 251/522] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:05 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1677 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:05.667280 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-672c0bd1-93a4-4aea-814b-1ef4dba89a69 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:05.676682 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-672c0bd1-93a4-4aea-814b-1ef4dba89a69 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1319 microversion: 2.1 time: 0.202687 Aug 26 11:09:05.677274 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 272/523] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:05 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:06.497085 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-38b68ed0-85b8-4539-95a7-6695b1c0b23a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:06.497766 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-38b68ed0-85b8-4539-95a7-6695b1c0b23a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:06.505146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38b68ed0-85b8-4539-95a7-6695b1c0b23a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:06.505665 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38b68ed0-85b8-4539-95a7-6695b1c0b23a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:06.506165 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38b68ed0-85b8-4539-95a7-6695b1c0b23a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:06.506883 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38b68ed0-85b8-4539-95a7-6695b1c0b23a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:06.507339 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38b68ed0-85b8-4539-95a7-6695b1c0b23a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:06.507763 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38b68ed0-85b8-4539-95a7-6695b1c0b23a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:06.576161 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-caab142e-6675-4e8c-8188-d39bdf2dc428 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:06.577005 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-caab142e-6675-4e8c-8188-d39bdf2dc428 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:06.582471 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:06.589251 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-caab142e-6675-4e8c-8188-d39bdf2dc428 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:06.590208 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-caab142e-6675-4e8c-8188-d39bdf2dc428 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:06.591385 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-caab142e-6675-4e8c-8188-d39bdf2dc428 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:06.592925 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-caab142e-6675-4e8c-8188-d39bdf2dc428 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:06.593780 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-caab142e-6675-4e8c-8188-d39bdf2dc428 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:06.595146 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-caab142e-6675-4e8c-8188-d39bdf2dc428 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:06.711327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-38b68ed0-85b8-4539-95a7-6695b1c0b23a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:06.726948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-38b68ed0-85b8-4539-95a7-6695b1c0b23a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:06.729949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-38b68ed0-85b8-4539-95a7-6695b1c0b23a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:06.732145 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-38b68ed0-85b8-4539-95a7-6695b1c0b23a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1725 microversion: 2.20 time: 0.239378 Aug 26 11:09:06.733027 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 252/524] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:06 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:09:06.746222 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8c17f14a-8b1a-4b0e-b513-d09a10e8a16d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:06.746222 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8c17f14a-8b1a-4b0e-b513-d09a10e8a16d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:06.758560 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c17f14a-8b1a-4b0e-b513-d09a10e8a16d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:06.759713 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c17f14a-8b1a-4b0e-b513-d09a10e8a16d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:06.760467 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c17f14a-8b1a-4b0e-b513-d09a10e8a16d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:06.761686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c17f14a-8b1a-4b0e-b513-d09a10e8a16d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:06.761920 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c17f14a-8b1a-4b0e-b513-d09a10e8a16d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:06.762438 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c17f14a-8b1a-4b0e-b513-d09a10e8a16d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:06.795487 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-caab142e-6675-4e8c-8188-d39bdf2dc428 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:06.806133 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-caab142e-6675-4e8c-8188-d39bdf2dc428 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1677 microversion: 2.1 time: 0.234842 Aug 26 11:09:06.807341 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 273/525] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:06 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1677 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:06.918314 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8c17f14a-8b1a-4b0e-b513-d09a10e8a16d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:06.927766 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8c17f14a-8b1a-4b0e-b513-d09a10e8a16d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1319 microversion: 2.1 time: 0.187467 Aug 26 11:09:06.928501 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 253/526] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:06 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:07.573010 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-2d6276c0-c6d7-4759-8234-6f83b8a43b63 req-5bfa20dd-57c8-461e-8f4a-3d112b06b930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ae91d9-0521-4d14-b2b6-e56f249c4181", "name": "network-vif-deleted", "tag": "36a4faa3-3a22-4156-8542-c0c5ea7e7f1c"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:07.598297 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-2d6276c0-c6d7-4759-8234-6f83b8a43b63 req-5bfa20dd-57c8-461e-8f4a-3d112b06b930 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:07.598965 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-2d6276c0-c6d7-4759-8234-6f83b8a43b63 req-5bfa20dd-57c8-461e-8f4a-3d112b06b930 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:07.599220 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-2d6276c0-c6d7-4759-8234-6f83b8a43b63 req-5bfa20dd-57c8-461e-8f4a-3d112b06b930 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:07.613646 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-2d6276c0-c6d7-4759-8234-6f83b8a43b63 req-5bfa20dd-57c8-461e-8f4a-3d112b06b930 service nova] Creating event network-vif-deleted:36a4faa3-3a22-4156-8542-c0c5ea7e7f1c for instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 on hv-cinder-85236 Aug 26 11:09:07.620278 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-2d6276c0-c6d7-4759-8234-6f83b8a43b63 req-5bfa20dd-57c8-461e-8f4a-3d112b06b930 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050744 Aug 26 11:09:07.621356 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 274/527] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:09:07.769124 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-bb33f03d-2774-4ef7-91f1-95eb718e8c93 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:07.770007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-bb33f03d-2774-4ef7-91f1-95eb718e8c93 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:07.779183 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb33f03d-2774-4ef7-91f1-95eb718e8c93 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:07.780065 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb33f03d-2774-4ef7-91f1-95eb718e8c93 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:07.780735 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb33f03d-2774-4ef7-91f1-95eb718e8c93 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:07.783477 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb33f03d-2774-4ef7-91f1-95eb718e8c93 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:07.784923 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb33f03d-2774-4ef7-91f1-95eb718e8c93 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:07.785589 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb33f03d-2774-4ef7-91f1-95eb718e8c93 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:07.834191 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-749e80f6-9d12-4558-ba51-265813c1db6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:07.835188 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-749e80f6-9d12-4558-ba51-265813c1db6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:07.846394 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-749e80f6-9d12-4558-ba51-265813c1db6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:07.847160 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-749e80f6-9d12-4558-ba51-265813c1db6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:07.847595 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-749e80f6-9d12-4558-ba51-265813c1db6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:07.848480 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-749e80f6-9d12-4558-ba51-265813c1db6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:07.849102 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-749e80f6-9d12-4558-ba51-265813c1db6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:07.849944 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-749e80f6-9d12-4558-ba51-265813c1db6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:07.879281 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-bb33f03d-2774-4ef7-91f1-95eb718e8c93 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:07.889166 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-bb33f03d-2774-4ef7-91f1-95eb718e8c93 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:07.891064 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-bb33f03d-2774-4ef7-91f1-95eb718e8c93 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:07.892491 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-bb33f03d-2774-4ef7-91f1-95eb718e8c93 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1657 microversion: 2.20 time: 0.130434 Aug 26 11:09:07.906901 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 254/528] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:07 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1657 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:09:07.951130 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9ace8578-d678-48fd-ba61-726be763beef tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:07.951904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9ace8578-d678-48fd-ba61-726be763beef tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:07.959345 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ace8578-d678-48fd-ba61-726be763beef tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:07.960042 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ace8578-d678-48fd-ba61-726be763beef tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:07.960426 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ace8578-d678-48fd-ba61-726be763beef tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:07.961125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ace8578-d678-48fd-ba61-726be763beef tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:07.961791 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ace8578-d678-48fd-ba61-726be763beef tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:07.962254 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ace8578-d678-48fd-ba61-726be763beef tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:08.052247 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-749e80f6-9d12-4558-ba51-265813c1db6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:08.061158 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-749e80f6-9d12-4558-ba51-265813c1db6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1677 microversion: 2.1 time: 0.233105 Aug 26 11:09:08.074025 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 275/529] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:07 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1677 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:08.144475 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9ace8578-d678-48fd-ba61-726be763beef tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:08.153719 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9ace8578-d678-48fd-ba61-726be763beef tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1319 microversion: 2.1 time: 0.207222 Aug 26 11:09:08.154359 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 255/530] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:07 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:08.917044 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-58d502b6-b659-461c-a3cc-fac6a0dd1681 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:08.917648 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-58d502b6-b659-461c-a3cc-fac6a0dd1681 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:08.925195 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-58d502b6-b659-461c-a3cc-fac6a0dd1681 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:08.925670 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-58d502b6-b659-461c-a3cc-fac6a0dd1681 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:08.926140 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-58d502b6-b659-461c-a3cc-fac6a0dd1681 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:08.926823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-58d502b6-b659-461c-a3cc-fac6a0dd1681 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:08.927570 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-58d502b6-b659-461c-a3cc-fac6a0dd1681 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:08.927992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-58d502b6-b659-461c-a3cc-fac6a0dd1681 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:08.962703 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-58d502b6-b659-461c-a3cc-fac6a0dd1681 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:08.963182 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-58d502b6-b659-461c-a3cc-fac6a0dd1681 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:08.963606 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-58d502b6-b659-461c-a3cc-fac6a0dd1681 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:08.964047 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-58d502b6-b659-461c-a3cc-fac6a0dd1681 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lazy-loading 'fault' on Instance uuid 01ae91d9-0521-4d14-b2b6-e56f249c4181 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:09:09.009382 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-58d502b6-b659-461c-a3cc-fac6a0dd1681 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:09.012541 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:09.024132 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-58d502b6-b659-461c-a3cc-fac6a0dd1681 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:09.026031 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-58d502b6-b659-461c-a3cc-fac6a0dd1681 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:09.027249 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-58d502b6-b659-461c-a3cc-fac6a0dd1681 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 200 len: 1371 microversion: 2.20 time: 0.114191 Aug 26 11:09:09.027811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 276/531] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:08 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 1371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:09:09.089561 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-579d32ce-b4a0-4a5f-bf2a-33da9f8df126 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:09.090214 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-579d32ce-b4a0-4a5f-bf2a-33da9f8df126 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:09.099278 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-579d32ce-b4a0-4a5f-bf2a-33da9f8df126 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:09.099776 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-579d32ce-b4a0-4a5f-bf2a-33da9f8df126 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:09.100217 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-579d32ce-b4a0-4a5f-bf2a-33da9f8df126 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:09.100963 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-579d32ce-b4a0-4a5f-bf2a-33da9f8df126 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:09.101423 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-579d32ce-b4a0-4a5f-bf2a-33da9f8df126 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:09.101852 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-579d32ce-b4a0-4a5f-bf2a-33da9f8df126 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:09.178730 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-975c6939-1bc0-4d1a-bbbd-a5cd1165fee0 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:09.179247 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-975c6939-1bc0-4d1a-bbbd-a5cd1165fee0 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:09.186752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-975c6939-1bc0-4d1a-bbbd-a5cd1165fee0 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:09.187248 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-975c6939-1bc0-4d1a-bbbd-a5cd1165fee0 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:09.187747 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-975c6939-1bc0-4d1a-bbbd-a5cd1165fee0 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:09.188955 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-975c6939-1bc0-4d1a-bbbd-a5cd1165fee0 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:09.189766 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-975c6939-1bc0-4d1a-bbbd-a5cd1165fee0 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:09.190303 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-975c6939-1bc0-4d1a-bbbd-a5cd1165fee0 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:09.299395 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-579d32ce-b4a0-4a5f-bf2a-33da9f8df126 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:09.308125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-579d32ce-b4a0-4a5f-bf2a-33da9f8df126 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1677 microversion: 2.1 time: 0.222454 Aug 26 11:09:09.309239 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 256/532] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:09 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:09.349242 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-975c6939-1bc0-4d1a-bbbd-a5cd1165fee0 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:09.357509 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-975c6939-1bc0-4d1a-bbbd-a5cd1165fee0 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1319 microversion: 2.1 time: 0.184051 Aug 26 11:09:09.358133 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 277/533] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:09 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:10.051588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f61016a0-6225-4586-8525-9486685558fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:10.052096 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f61016a0-6225-4586-8525-9486685558fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:10.058898 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f61016a0-6225-4586-8525-9486685558fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:10.059393 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f61016a0-6225-4586-8525-9486685558fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:10.059837 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f61016a0-6225-4586-8525-9486685558fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:10.060541 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f61016a0-6225-4586-8525-9486685558fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:10.060986 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f61016a0-6225-4586-8525-9486685558fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:10.061408 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f61016a0-6225-4586-8525-9486685558fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:10.084362 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-f61016a0-6225-4586-8525-9486685558fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] HTTP exception thrown: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f61016a0-6225-4586-8525-9486685558fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Request method failure captured: Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 HTTP/1.1 Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKjRFHZ44GBZQ9If55-jSqgIoqi-rUu1ZMNZQk7koc0ph8O9xqvn1jpC8ZiSpv_a9qksE9wcI2JQQd4dmhh3zEz8UgQLhcZIrDFSG2Yhl8EKXMMM9k7HHtx8ngoASi6GVqDPdkQv3P9K4jrssqzKmgH6zks9EftRTBsct3YJbErETcQ Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: 78251e5bdb2548d1bb18aacd4ccbcd34 Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:09:10.088356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:09:10.095110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78251e5bdb2548d1bb18aacd4ccbcd34"}]}] Aug 26 11:09:10.095110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:09:10.095110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 78251e5bdb2548d1bb18aacd4ccbcd34 Aug 26 11:09:10.095110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:09:10.095110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeShelveTestJSON-1222277151-project Aug 26 11:09:10.095110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:09:10.095110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:09:10.095110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: aedac3f62dd94f87b968f6c71d68a0a3 Aug 26 11:09:10.095110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1222277151-project Aug 26 11:09:10.095110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:09:10.095110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. Aug 26 11:09:10.095110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': '01ae91d9-0521-4d14-b2b6-e56f249c4181'} Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:09:10.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. Aug 26 11:09:10.100097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:10.102182 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f61016a0-6225-4586-8525-9486685558fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Returning 404 to user: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:09:10.102182 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f61016a0-6225-4586-8525-9486685558fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 404 len: 111 microversion: 2.20 time: 0.042755 Aug 26 11:09:10.102182 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 257/534] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:10 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 11:09:10.111833 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b30a3522-ec30-4946-81b9-264fdd60d111 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '.version_select at 0x7f1a6896faf0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:10.116576 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b30a3522-ec30-4946-81b9-264fdd60d111 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [08f834ab-4ea4-44ab-a227-332886a722d4] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 26 11:09:10.331281 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-376ca3ec-4f85-4a05-9248-6dbc8670ee80 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:10.331814 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-376ca3ec-4f85-4a05-9248-6dbc8670ee80 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:10.338428 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-376ca3ec-4f85-4a05-9248-6dbc8670ee80 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:10.338845 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-376ca3ec-4f85-4a05-9248-6dbc8670ee80 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:10.339277 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-376ca3ec-4f85-4a05-9248-6dbc8670ee80 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:10.340012 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-376ca3ec-4f85-4a05-9248-6dbc8670ee80 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:10.340496 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-376ca3ec-4f85-4a05-9248-6dbc8670ee80 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:10.340888 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-376ca3ec-4f85-4a05-9248-6dbc8670ee80 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:10.356795 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:10.505324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-376ca3ec-4f85-4a05-9248-6dbc8670ee80 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:10.514961 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-376ca3ec-4f85-4a05-9248-6dbc8670ee80 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1677 microversion: 2.1 time: 0.188009 Aug 26 11:09:10.526517 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 258/535] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:10 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1677 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:10.532420 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0e06ba38-8c8e-4e6e-a498-06ce69c65ff1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:10.533457 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0e06ba38-8c8e-4e6e-a498-06ce69c65ff1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:10.539992 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0e06ba38-8c8e-4e6e-a498-06ce69c65ff1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:10.540744 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0e06ba38-8c8e-4e6e-a498-06ce69c65ff1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:10.541362 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0e06ba38-8c8e-4e6e-a498-06ce69c65ff1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:10.542169 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0e06ba38-8c8e-4e6e-a498-06ce69c65ff1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:10.542806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0e06ba38-8c8e-4e6e-a498-06ce69c65ff1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:10.543237 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0e06ba38-8c8e-4e6e-a498-06ce69c65ff1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:10.569113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:10.593747 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=6 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:10.692027 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0e06ba38-8c8e-4e6e-a498-06ce69c65ff1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:10.700042 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0e06ba38-8c8e-4e6e-a498-06ce69c65ff1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1319 microversion: 2.1 time: 0.172298 Aug 26 11:09:10.700653 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 259/536] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:10 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:10.730617 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:11.125104 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO oslo.messaging._drivers.impl_rabbit [None req-b30a3522-ec30-4946-81b9-264fdd60d111 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [08f834ab-4ea4-44ab-a227-332886a722d4] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 46294. Aug 26 11:09:11.148793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b30a3522-ec30-4946-81b9-264fdd60d111 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-518548241" status: 204 len: 0 microversion: 2.20 time: 1.043976 Aug 26 11:09:11.149382 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 278/537] 10.222.0.40 () {60 vars in 1259 bytes} [Fri Aug 26 11:09:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-518548241 => generated 0 bytes in 1046 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 11:09:11.537077 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a72b6f5f-793e-4a6c-b5d1-e8a61fcdcc2b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:11.537816 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a72b6f5f-793e-4a6c-b5d1-e8a61fcdcc2b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:11.544954 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a72b6f5f-793e-4a6c-b5d1-e8a61fcdcc2b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:11.545539 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a72b6f5f-793e-4a6c-b5d1-e8a61fcdcc2b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:11.546084 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a72b6f5f-793e-4a6c-b5d1-e8a61fcdcc2b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:11.546811 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a72b6f5f-793e-4a6c-b5d1-e8a61fcdcc2b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:11.547948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a72b6f5f-793e-4a6c-b5d1-e8a61fcdcc2b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:11.548373 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a72b6f5f-793e-4a6c-b5d1-e8a61fcdcc2b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:11.695639 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a72b6f5f-793e-4a6c-b5d1-e8a61fcdcc2b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:11.705402 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a72b6f5f-793e-4a6c-b5d1-e8a61fcdcc2b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1677 microversion: 2.1 time: 0.172408 Aug 26 11:09:11.705895 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 260/538] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:11 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:11.724783 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5f068d34-5dd2-4294-a87b-62db9ab63fec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:11.725857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5f068d34-5dd2-4294-a87b-62db9ab63fec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:11.737238 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5f068d34-5dd2-4294-a87b-62db9ab63fec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:11.737900 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5f068d34-5dd2-4294-a87b-62db9ab63fec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:11.738443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5f068d34-5dd2-4294-a87b-62db9ab63fec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:11.739298 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5f068d34-5dd2-4294-a87b-62db9ab63fec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:11.739908 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5f068d34-5dd2-4294-a87b-62db9ab63fec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:11.740416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5f068d34-5dd2-4294-a87b-62db9ab63fec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:11.882877 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-555a23b4-3697-488e-9d16-ac1ccee16c0d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Action: 'create', calling method: .version_select at 0x7f1a68c97b80>, body: {"keypair": {"name": "tempest-keypair-402353492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbrt2GkhZcMxcSdtrsovwgKzI45TrlsfDVYaSQkqysN0Ypdo/eHFQDpm6RLd8opk6rbIebHVfMvZEl6C0oVqVtj8x6hzXQzPKi9/uGAE7DRJUjF3e0XF4j/9ofYPv2VwQ=="}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:11.903469 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-555a23b4-3697-488e-9d16-ac1ccee16c0d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Getting quotas for project 78251e5bdb2548d1bb18aacd4ccbcd34. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:09:11.909252 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-555a23b4-3697-488e-9d16-ac1ccee16c0d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Getting quotas for user aedac3f62dd94f87b968f6c71d68a0a3 and project 78251e5bdb2548d1bb18aacd4ccbcd34. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:09:11.925157 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR oslo.messaging._drivers.impl_rabbit [None req-555a23b4-3697-488e-9d16-ac1ccee16c0d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [32c53e48-e41a-4c5b-b622-a9b4ab8e7d9f] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 26 11:09:11.930666 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5f068d34-5dd2-4294-a87b-62db9ab63fec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:11.939415 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5f068d34-5dd2-4294-a87b-62db9ab63fec tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1319 microversion: 2.1 time: 0.221138 Aug 26 11:09:11.940095 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 279/539] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:11 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:11.990948 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-82b24d4b-de28-4c71-96e4-4dc1e34d670c req-9a7aa8ee-95b9-453a-a3bc-a3c596ba5b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca6ba27-f52a-4bcb-9e67-d09645be0b19", "name": "network-vif-plugged", "status": "completed", "tag": "2088f2dc-209d-4e12-8ff3-5642dd1ed8b2"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:12.008234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-82b24d4b-de28-4c71-96e4-4dc1e34d670c req-9a7aa8ee-95b9-453a-a3bc-a3c596ba5b38 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:12.008852 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-82b24d4b-de28-4c71-96e4-4dc1e34d670c req-9a7aa8ee-95b9-453a-a3bc-a3c596ba5b38 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:12.009298 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-82b24d4b-de28-4c71-96e4-4dc1e34d670c req-9a7aa8ee-95b9-453a-a3bc-a3c596ba5b38 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:12.023220 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-82b24d4b-de28-4c71-96e4-4dc1e34d670c req-9a7aa8ee-95b9-453a-a3bc-a3c596ba5b38 service nova] Creating event network-vif-plugged:2088f2dc-209d-4e12-8ff3-5642dd1ed8b2 for instance aca6ba27-f52a-4bcb-9e67-d09645be0b19 on hv-cinder-85236 Aug 26 11:09:12.029195 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-82b24d4b-de28-4c71-96e4-4dc1e34d670c req-9a7aa8ee-95b9-453a-a3bc-a3c596ba5b38 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042291 Aug 26 11:09:12.030034 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 280/540] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:09:12.730313 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-93b40ef9-354c-4739-aabf-d6e50fd19037 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:12.731040 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-93b40ef9-354c-4739-aabf-d6e50fd19037 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:12.740005 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-93b40ef9-354c-4739-aabf-d6e50fd19037 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:12.740497 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-93b40ef9-354c-4739-aabf-d6e50fd19037 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:12.740935 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-93b40ef9-354c-4739-aabf-d6e50fd19037 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:12.741642 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-93b40ef9-354c-4739-aabf-d6e50fd19037 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:12.742128 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-93b40ef9-354c-4739-aabf-d6e50fd19037 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:12.742554 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-93b40ef9-354c-4739-aabf-d6e50fd19037 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:12.886067 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-93b40ef9-354c-4739-aabf-d6e50fd19037 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:12.894673 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-93b40ef9-354c-4739-aabf-d6e50fd19037 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1677 microversion: 2.1 time: 0.169823 Aug 26 11:09:12.895469 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 281/541] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:12 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:12.933465 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO oslo.messaging._drivers.impl_rabbit [None req-555a23b4-3697-488e-9d16-ac1ccee16c0d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [32c53e48-e41a-4c5b-b622-a9b4ab8e7d9f] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 46312. Aug 26 11:09:12.951540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-555a23b4-3697-488e-9d16-ac1ccee16c0d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.074382 Aug 26 11:09:12.952378 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 261/542] 10.222.0.40 () {62 vars in 1200 bytes} [Fri Aug 26 11:09:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1077 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 26 11:09:12.963444 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-61c67b76-3508-4d62-86c5-157a0d6bac24 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:12.964055 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-61c67b76-3508-4d62-86c5-157a0d6bac24 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:12.970646 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-61c67b76-3508-4d62-86c5-157a0d6bac24 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:12.971140 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-61c67b76-3508-4d62-86c5-157a0d6bac24 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:12.971571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-61c67b76-3508-4d62-86c5-157a0d6bac24 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:12.972287 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-61c67b76-3508-4d62-86c5-157a0d6bac24 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:12.972742 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-61c67b76-3508-4d62-86c5-157a0d6bac24 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:12.973162 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-61c67b76-3508-4d62-86c5-157a0d6bac24 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:13.153821 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-61c67b76-3508-4d62-86c5-157a0d6bac24 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:13.167672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-61c67b76-3508-4d62-86c5-157a0d6bac24 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1319 microversion: 2.1 time: 0.207983 Aug 26 11:09:13.168655 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 282/543] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:12 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:13.916833 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0bfc932f-3576-4575-852d-cee0de7bf696 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:13.917590 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0bfc932f-3576-4575-852d-cee0de7bf696 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:13.927331 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bfc932f-3576-4575-852d-cee0de7bf696 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:13.928111 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bfc932f-3576-4575-852d-cee0de7bf696 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:13.928573 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bfc932f-3576-4575-852d-cee0de7bf696 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:13.929475 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bfc932f-3576-4575-852d-cee0de7bf696 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:13.930002 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bfc932f-3576-4575-852d-cee0de7bf696 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:13.930517 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bfc932f-3576-4575-852d-cee0de7bf696 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:14.080949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0bfc932f-3576-4575-852d-cee0de7bf696 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:14.090433 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0bfc932f-3576-4575-852d-cee0de7bf696 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1677 microversion: 2.1 time: 0.178150 Aug 26 11:09:14.091006 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 262/544] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:13 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:14.190245 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-55a74ec3-6709-4a7e-bd98-788d78443270 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:14.191396 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-55a74ec3-6709-4a7e-bd98-788d78443270 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:14.198496 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-55a74ec3-6709-4a7e-bd98-788d78443270 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:14.198969 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-55a74ec3-6709-4a7e-bd98-788d78443270 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:14.199625 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-55a74ec3-6709-4a7e-bd98-788d78443270 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:14.200375 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-55a74ec3-6709-4a7e-bd98-788d78443270 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:14.200843 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-55a74ec3-6709-4a7e-bd98-788d78443270 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:14.201263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-55a74ec3-6709-4a7e-bd98-788d78443270 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:14.362444 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-55a74ec3-6709-4a7e-bd98-788d78443270 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:14.371680 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-55a74ec3-6709-4a7e-bd98-788d78443270 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1319 microversion: 2.1 time: 0.185874 Aug 26 11:09:14.372553 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 283/545] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:14 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:14.418796 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-36535843", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d146ca4-0dba-4d73-bb20-a2cc8eb29a90"}], "security_groups": [{"name": "tempest-securitygroup--2038989380"}], "key_name": "tempest-keypair-402353492", "user_data": "}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:14.535135 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] validate_networks() for [('1d146ca4-0dba-4d73-bb20-a2cc8eb29a90', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:09:14.946609 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:09:14.948147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:09:14.948147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:09:14.948670 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:09:14.948893 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:09:14.950940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:14.962526 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:14.963237 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:14.963836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:14.964566 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:14.965017 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:14.965492 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:14.984298 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Getting quotas for project 78251e5bdb2548d1bb18aacd4ccbcd34. Resources: {'instances', 'ram', 'cores'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:09:14.990048 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Getting quotas for user aedac3f62dd94f87b968f6c71d68a0a3 and project 78251e5bdb2548d1bb18aacd4ccbcd34. Resources: {'instances', 'ram', 'cores'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:09:15.002996 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:09:15.005290 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:09:15.062279 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6333c2b8-1545-40fc-bb1c-c48aaaa755d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.647897 Aug 26 11:09:15.063192 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 263/546] 10.222.0.40 () {62 vars in 1188 bytes} [Fri Aug 26 11:09:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 26 11:09:15.074306 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-7fa034bd-aba6-42b3-9dd6-6dd5b43de845 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:15.075021 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-7fa034bd-aba6-42b3-9dd6-6dd5b43de845 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:15.113936 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-05fd4246-baf6-4c9b-9174-43886c34189f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:15.114652 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-05fd4246-baf6-4c9b-9174-43886c34189f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:15.121954 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-05fd4246-baf6-4c9b-9174-43886c34189f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:15.122388 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-05fd4246-baf6-4c9b-9174-43886c34189f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:15.123133 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-05fd4246-baf6-4c9b-9174-43886c34189f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:15.123719 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-05fd4246-baf6-4c9b-9174-43886c34189f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:15.124169 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-05fd4246-baf6-4c9b-9174-43886c34189f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:15.124764 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-05fd4246-baf6-4c9b-9174-43886c34189f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:15.141686 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7fa034bd-aba6-42b3-9dd6-6dd5b43de845 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:15.153909 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7fa034bd-aba6-42b3-9dd6-6dd5b43de845 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:15.155791 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7fa034bd-aba6-42b3-9dd6-6dd5b43de845 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:15.158982 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-7fa034bd-aba6-42b3-9dd6-6dd5b43de845 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1279 microversion: 2.20 time: 0.087435 Aug 26 11:09:15.159576 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 284/547] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:15 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:09:15.279798 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-05fd4246-baf6-4c9b-9174-43886c34189f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:15.291193 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-05fd4246-baf6-4c9b-9174-43886c34189f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1677 microversion: 2.1 time: 0.180996 Aug 26 11:09:15.292077 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 264/548] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:15 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:15.395142 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-93718302-a6f7-4539-84e3-73db869d3609 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:15.396321 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-93718302-a6f7-4539-84e3-73db869d3609 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:15.405159 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-93718302-a6f7-4539-84e3-73db869d3609 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:15.405642 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-93718302-a6f7-4539-84e3-73db869d3609 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:15.406869 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-93718302-a6f7-4539-84e3-73db869d3609 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:15.407571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-93718302-a6f7-4539-84e3-73db869d3609 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:15.408023 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-93718302-a6f7-4539-84e3-73db869d3609 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:15.408442 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-93718302-a6f7-4539-84e3-73db869d3609 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:15.553756 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-93718302-a6f7-4539-84e3-73db869d3609 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:15.562164 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-93718302-a6f7-4539-84e3-73db869d3609 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1508 microversion: 2.1 time: 0.170922 Aug 26 11:09:15.562771 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 285/549] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:15 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:15.588110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-35969802-8ee9-49b5-9c1e-a04f46ca91c7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35763f0d-c915-4586-9972-cef9b19aad94", "device": "/dev/sdb"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:15.592644 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-35969802-8ee9-49b5-9c1e-a04f46ca91c7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:15.604724 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-35969802-8ee9-49b5-9c1e-a04f46ca91c7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:15.605322 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-35969802-8ee9-49b5-9c1e-a04f46ca91c7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:15.605758 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-35969802-8ee9-49b5-9c1e-a04f46ca91c7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:15.606504 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-35969802-8ee9-49b5-9c1e-a04f46ca91c7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:15.606955 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-35969802-8ee9-49b5-9c1e-a04f46ca91c7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:15.607439 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-35969802-8ee9-49b5-9c1e-a04f46ca91c7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:15.913548 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-35969802-8ee9-49b5-9c1e-a04f46ca91c7 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "POST /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332102 Aug 26 11:09:15.914625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 265/550] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 11:09:15 2022] POST /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:09:16.181747 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-9e07ffc4-e9af-4c2c-93a0-4f6be51bdd6a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:16.182302 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9e07ffc4-e9af-4c2c-93a0-4f6be51bdd6a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:16.189294 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9e07ffc4-e9af-4c2c-93a0-4f6be51bdd6a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:16.189789 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9e07ffc4-e9af-4c2c-93a0-4f6be51bdd6a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:16.190265 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9e07ffc4-e9af-4c2c-93a0-4f6be51bdd6a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:16.190973 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9e07ffc4-e9af-4c2c-93a0-4f6be51bdd6a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:16.191416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9e07ffc4-e9af-4c2c-93a0-4f6be51bdd6a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:16.191841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9e07ffc4-e9af-4c2c-93a0-4f6be51bdd6a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:16.259709 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9e07ffc4-e9af-4c2c-93a0-4f6be51bdd6a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:16.268623 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9e07ffc4-e9af-4c2c-93a0-4f6be51bdd6a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:16.270115 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9e07ffc4-e9af-4c2c-93a0-4f6be51bdd6a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:16.271228 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-9e07ffc4-e9af-4c2c-93a0-4f6be51bdd6a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1331 microversion: 2.20 time: 0.093513 Aug 26 11:09:16.271790 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 286/551] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:16 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:09:16.314212 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3a81851f-5aeb-4845-a1b3-2750a90e00fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:16.314847 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3a81851f-5aeb-4845-a1b3-2750a90e00fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:16.321802 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3a81851f-5aeb-4845-a1b3-2750a90e00fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:16.322378 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3a81851f-5aeb-4845-a1b3-2750a90e00fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:16.322772 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3a81851f-5aeb-4845-a1b3-2750a90e00fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:16.323637 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3a81851f-5aeb-4845-a1b3-2750a90e00fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:16.324453 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3a81851f-5aeb-4845-a1b3-2750a90e00fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:16.324882 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3a81851f-5aeb-4845-a1b3-2750a90e00fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:16.724934 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3a81851f-5aeb-4845-a1b3-2750a90e00fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:16.732826 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3a81851f-5aeb-4845-a1b3-2750a90e00fc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1677 microversion: 2.1 time: 0.423607 Aug 26 11:09:16.733414 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 266/552] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:16 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1677 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:17.294485 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-2e5b7403-90fd-4783-8bf3-afbf97724117 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:17.295021 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-2e5b7403-90fd-4783-8bf3-afbf97724117 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:17.303311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2e5b7403-90fd-4783-8bf3-afbf97724117 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:17.303837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2e5b7403-90fd-4783-8bf3-afbf97724117 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:17.304220 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2e5b7403-90fd-4783-8bf3-afbf97724117 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:17.304921 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2e5b7403-90fd-4783-8bf3-afbf97724117 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:17.305369 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2e5b7403-90fd-4783-8bf3-afbf97724117 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:17.305785 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2e5b7403-90fd-4783-8bf3-afbf97724117 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:17.376354 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-2e5b7403-90fd-4783-8bf3-afbf97724117 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:17.385045 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-2e5b7403-90fd-4783-8bf3-afbf97724117 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:17.386539 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-2e5b7403-90fd-4783-8bf3-afbf97724117 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:17.387646 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-2e5b7403-90fd-4783-8bf3-afbf97724117 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1337 microversion: 2.20 time: 0.097351 Aug 26 11:09:17.388239 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 287/553] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:17 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1337 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:09:17.755804 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-90210c4a-43be-40a5-ba90-d3aceafc6f8e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:17.756427 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-90210c4a-43be-40a5-ba90-d3aceafc6f8e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:17.763177 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-90210c4a-43be-40a5-ba90-d3aceafc6f8e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:17.763652 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-90210c4a-43be-40a5-ba90-d3aceafc6f8e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:17.764236 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-90210c4a-43be-40a5-ba90-d3aceafc6f8e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:17.765012 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-90210c4a-43be-40a5-ba90-d3aceafc6f8e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:17.765482 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-90210c4a-43be-40a5-ba90-d3aceafc6f8e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:17.766953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-90210c4a-43be-40a5-ba90-d3aceafc6f8e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:17.910444 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-90210c4a-43be-40a5-ba90-d3aceafc6f8e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:17.918853 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-90210c4a-43be-40a5-ba90-d3aceafc6f8e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1654 microversion: 2.1 time: 0.166997 Aug 26 11:09:17.919436 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 267/554] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:17 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1654 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:17.941297 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b5ef72bf-90c4-4caa-8299-41f789a85091 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:17.948401 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b5ef72bf-90c4-4caa-8299-41f789a85091 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:17.948401 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b5ef72bf-90c4-4caa-8299-41f789a85091 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:17.949014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b5ef72bf-90c4-4caa-8299-41f789a85091 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:17.973568 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b5ef72bf-90c4-4caa-8299-41f789a85091 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Going to try to start instance {{(pid=120605) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 26 11:09:18.023348 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b5ef72bf-90c4-4caa-8299-41f789a85091 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "POST /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.086955 Aug 26 11:09:18.024423 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 288/555] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 11:09:17 2022] POST /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:09:18.039573 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-df459064-f875-4b26-9a70-7d557381166e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:18.040153 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-df459064-f875-4b26-9a70-7d557381166e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:18.050722 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-df459064-f875-4b26-9a70-7d557381166e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:18.051242 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-df459064-f875-4b26-9a70-7d557381166e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:18.051948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-df459064-f875-4b26-9a70-7d557381166e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:18.052728 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-df459064-f875-4b26-9a70-7d557381166e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:18.053194 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-df459064-f875-4b26-9a70-7d557381166e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:18.053627 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-df459064-f875-4b26-9a70-7d557381166e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:18.209727 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-df459064-f875-4b26-9a70-7d557381166e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:18.218328 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-df459064-f875-4b26-9a70-7d557381166e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1663 microversion: 2.1 time: 0.182607 Aug 26 11:09:18.218947 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 268/556] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:18 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1663 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:18.264794 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-b5b1b96d-e185-41b5-9042-6e772d55ec8e req-5c81bb97-de3b-4401-90b8-e1311c7b1e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3983ebc-9955-4f0c-9ffd-0107d1a22723", "tag": "6d309e62-5a5f-4a29-b1a7-66190210585a"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:18.277515 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-b5b1b96d-e185-41b5-9042-6e772d55ec8e req-5c81bb97-de3b-4401-90b8-e1311c7b1e6f service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:18.278386 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-b5b1b96d-e185-41b5-9042-6e772d55ec8e req-5c81bb97-de3b-4401-90b8-e1311c7b1e6f service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:18.278818 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-b5b1b96d-e185-41b5-9042-6e772d55ec8e req-5c81bb97-de3b-4401-90b8-e1311c7b1e6f service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:18.292187 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-b5b1b96d-e185-41b5-9042-6e772d55ec8e req-5c81bb97-de3b-4401-90b8-e1311c7b1e6f service nova] Creating event network-changed:6d309e62-5a5f-4a29-b1a7-66190210585a for instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 on hv-cinder-85236 Aug 26 11:09:18.297794 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-b5b1b96d-e185-41b5-9042-6e772d55ec8e req-5c81bb97-de3b-4401-90b8-e1311c7b1e6f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037311 Aug 26 11:09:18.298848 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 289/557] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:09:18.412302 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e54b6800-d055-434f-95a1-1cecad96923f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:18.412916 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e54b6800-d055-434f-95a1-1cecad96923f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:18.419427 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e54b6800-d055-434f-95a1-1cecad96923f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:18.420044 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e54b6800-d055-434f-95a1-1cecad96923f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:18.420501 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e54b6800-d055-434f-95a1-1cecad96923f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:18.421282 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e54b6800-d055-434f-95a1-1cecad96923f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:18.421858 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e54b6800-d055-434f-95a1-1cecad96923f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:18.422347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e54b6800-d055-434f-95a1-1cecad96923f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:18.568761 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e54b6800-d055-434f-95a1-1cecad96923f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:18.580237 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e54b6800-d055-434f-95a1-1cecad96923f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:18.583232 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e54b6800-d055-434f-95a1-1cecad96923f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:18.584576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e54b6800-d055-434f-95a1-1cecad96923f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1405 microversion: 2.20 time: 0.176159 Aug 26 11:09:18.585309 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 269/558] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:18 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:09:19.241374 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-705c0876-c60b-4504-bd6d-8d884604ceb7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:19.242096 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-705c0876-c60b-4504-bd6d-8d884604ceb7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:19.249747 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-705c0876-c60b-4504-bd6d-8d884604ceb7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:19.250289 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-705c0876-c60b-4504-bd6d-8d884604ceb7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:19.250829 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-705c0876-c60b-4504-bd6d-8d884604ceb7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:19.251491 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-705c0876-c60b-4504-bd6d-8d884604ceb7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:19.251945 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-705c0876-c60b-4504-bd6d-8d884604ceb7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:19.252361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-705c0876-c60b-4504-bd6d-8d884604ceb7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:19.391215 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-705c0876-c60b-4504-bd6d-8d884604ceb7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:19.399490 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-705c0876-c60b-4504-bd6d-8d884604ceb7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1663 microversion: 2.1 time: 0.162212 Aug 26 11:09:19.400065 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 290/559] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:19 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:19.610809 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f7f48161-fcc6-4888-8414-5460471d53d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:19.611897 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f7f48161-fcc6-4888-8414-5460471d53d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:19.623417 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7f48161-fcc6-4888-8414-5460471d53d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:19.624236 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7f48161-fcc6-4888-8414-5460471d53d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:19.625440 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7f48161-fcc6-4888-8414-5460471d53d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:19.626650 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7f48161-fcc6-4888-8414-5460471d53d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:19.627206 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7f48161-fcc6-4888-8414-5460471d53d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:19.627841 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7f48161-fcc6-4888-8414-5460471d53d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:19.695376 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5842f005-e94b-4e4f-937e-9abc0dc4c2e7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:19.696147 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5842f005-e94b-4e4f-937e-9abc0dc4c2e7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:19.705876 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5842f005-e94b-4e4f-937e-9abc0dc4c2e7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:19.706450 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5842f005-e94b-4e4f-937e-9abc0dc4c2e7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:19.707074 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5842f005-e94b-4e4f-937e-9abc0dc4c2e7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:19.708277 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5842f005-e94b-4e4f-937e-9abc0dc4c2e7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:19.708939 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5842f005-e94b-4e4f-937e-9abc0dc4c2e7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:19.709557 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5842f005-e94b-4e4f-937e-9abc0dc4c2e7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:19.794192 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f7f48161-fcc6-4888-8414-5460471d53d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:19.802974 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f7f48161-fcc6-4888-8414-5460471d53d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:19.804427 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f7f48161-fcc6-4888-8414-5460471d53d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:19.805556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f7f48161-fcc6-4888-8414-5460471d53d0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1405 microversion: 2.20 time: 0.201246 Aug 26 11:09:19.806144 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 270/560] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:19 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:09:19.819334 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-5842f005-e94b-4e4f-937e-9abc0dc4c2e7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lazy-loading 'services' on Instance uuid 9530d01a-c2a4-44f2-a631-31faa3921205 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:09:19.901204 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5842f005-e94b-4e4f-937e-9abc0dc4c2e7 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments/eb81a146-21da-456b-9b60-0ae882a14aec" status: 202 len: 0 microversion: 2.1 time: 0.211846 Aug 26 11:09:19.901712 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 291/561] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 11:09:19 2022] DELETE /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments/eb81a146-21da-456b-9b60-0ae882a14aec => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 11:09:19.910811 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ef7c2334-163a-48a2-b1b8-25b9ccbbe630 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:19.913036 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ef7c2334-163a-48a2-b1b8-25b9ccbbe630 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:19.919582 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ef7c2334-163a-48a2-b1b8-25b9ccbbe630 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:19.920066 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ef7c2334-163a-48a2-b1b8-25b9ccbbe630 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:19.920504 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ef7c2334-163a-48a2-b1b8-25b9ccbbe630 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:19.921236 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ef7c2334-163a-48a2-b1b8-25b9ccbbe630 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:19.921696 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ef7c2334-163a-48a2-b1b8-25b9ccbbe630 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:19.922709 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ef7c2334-163a-48a2-b1b8-25b9ccbbe630 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:19.956234 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ef7c2334-163a-48a2-b1b8-25b9ccbbe630 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049947 Aug 26 11:09:19.957061 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 271/562] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:09:19 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:09:20.424460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-6f352699-4ac6-49b8-ba2d-e74945920494 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:20.425225 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-6f352699-4ac6-49b8-ba2d-e74945920494 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:20.431650 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6f352699-4ac6-49b8-ba2d-e74945920494 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:20.432134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6f352699-4ac6-49b8-ba2d-e74945920494 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:20.432609 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6f352699-4ac6-49b8-ba2d-e74945920494 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:20.433337 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6f352699-4ac6-49b8-ba2d-e74945920494 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:20.433724 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6f352699-4ac6-49b8-ba2d-e74945920494 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:20.434339 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6f352699-4ac6-49b8-ba2d-e74945920494 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:20.618961 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6f352699-4ac6-49b8-ba2d-e74945920494 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:20.630482 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-6f352699-4ac6-49b8-ba2d-e74945920494 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1663 microversion: 2.1 time: 0.211578 Aug 26 11:09:20.631171 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 292/563] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:20 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1663 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:20.834448 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3924d8b0-cc97-4f9d-bba8-5a19552df4a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:20.835303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3924d8b0-cc97-4f9d-bba8-5a19552df4a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:20.845105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3924d8b0-cc97-4f9d-bba8-5a19552df4a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:20.845790 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3924d8b0-cc97-4f9d-bba8-5a19552df4a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:20.846429 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3924d8b0-cc97-4f9d-bba8-5a19552df4a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:20.847412 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3924d8b0-cc97-4f9d-bba8-5a19552df4a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:20.848110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3924d8b0-cc97-4f9d-bba8-5a19552df4a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:20.848677 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3924d8b0-cc97-4f9d-bba8-5a19552df4a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:20.968967 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b9c09c97-473c-44aa-9af4-0691d90fc6bd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:20.971852 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b9c09c97-473c-44aa-9af4-0691d90fc6bd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:20.978292 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b9c09c97-473c-44aa-9af4-0691d90fc6bd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:20.978877 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b9c09c97-473c-44aa-9af4-0691d90fc6bd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:20.979380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b9c09c97-473c-44aa-9af4-0691d90fc6bd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:20.980346 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b9c09c97-473c-44aa-9af4-0691d90fc6bd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:20.981112 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b9c09c97-473c-44aa-9af4-0691d90fc6bd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:20.981746 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b9c09c97-473c-44aa-9af4-0691d90fc6bd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:20.994754 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3924d8b0-cc97-4f9d-bba8-5a19552df4a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:21.007221 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3924d8b0-cc97-4f9d-bba8-5a19552df4a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:21.009319 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3924d8b0-cc97-4f9d-bba8-5a19552df4a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:21.010893 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3924d8b0-cc97-4f9d-bba8-5a19552df4a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1405 microversion: 2.20 time: 0.183213 Aug 26 11:09:21.011487 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 272/564] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:20 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:09:21.018806 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b9c09c97-473c-44aa-9af4-0691d90fc6bd tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053967 Aug 26 11:09:21.019367 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 293/565] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:09:20 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:09:21.655527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-653f4423-899a-4838-afca-3c92ddd65418 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:21.656657 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-653f4423-899a-4838-afca-3c92ddd65418 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:21.662939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-653f4423-899a-4838-afca-3c92ddd65418 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:21.663426 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-653f4423-899a-4838-afca-3c92ddd65418 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:21.663854 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-653f4423-899a-4838-afca-3c92ddd65418 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:21.664542 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-653f4423-899a-4838-afca-3c92ddd65418 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:21.665187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-653f4423-899a-4838-afca-3c92ddd65418 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:21.665407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-653f4423-899a-4838-afca-3c92ddd65418 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:21.805830 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-653f4423-899a-4838-afca-3c92ddd65418 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:21.817854 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-653f4423-899a-4838-afca-3c92ddd65418 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1667 microversion: 2.1 time: 0.166015 Aug 26 11:09:21.818770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 273/566] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:21 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1667 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:22.033773 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c27fb725-2423-4f82-8c32-393d00b19460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:22.036625 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c27fb725-2423-4f82-8c32-393d00b19460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:22.043854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c27fb725-2423-4f82-8c32-393d00b19460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:22.044437 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c27fb725-2423-4f82-8c32-393d00b19460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:22.044946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c27fb725-2423-4f82-8c32-393d00b19460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:22.045735 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c27fb725-2423-4f82-8c32-393d00b19460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:22.046340 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c27fb725-2423-4f82-8c32-393d00b19460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:22.047343 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c27fb725-2423-4f82-8c32-393d00b19460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:22.048588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a04fe467-2b08-4fc8-98e2-dad55bd0e57d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:22.049460 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a04fe467-2b08-4fc8-98e2-dad55bd0e57d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:22.056414 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a04fe467-2b08-4fc8-98e2-dad55bd0e57d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:22.057246 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a04fe467-2b08-4fc8-98e2-dad55bd0e57d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:22.057683 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a04fe467-2b08-4fc8-98e2-dad55bd0e57d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:22.058412 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a04fe467-2b08-4fc8-98e2-dad55bd0e57d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:22.058885 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a04fe467-2b08-4fc8-98e2-dad55bd0e57d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:22.059273 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a04fe467-2b08-4fc8-98e2-dad55bd0e57d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:22.084179 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c27fb725-2423-4f82-8c32-393d00b19460 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054578 Aug 26 11:09:22.084970 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 294/567] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:09:22 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:09:22.210238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a04fe467-2b08-4fc8-98e2-dad55bd0e57d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:22.223386 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a04fe467-2b08-4fc8-98e2-dad55bd0e57d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:22.225805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a04fe467-2b08-4fc8-98e2-dad55bd0e57d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:22.227594 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a04fe467-2b08-4fc8-98e2-dad55bd0e57d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1405 microversion: 2.20 time: 0.194411 Aug 26 11:09:22.228511 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 274/568] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:22 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:09:23.098471 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-caf9567d-162f-428d-b655-7db62b299f4f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:23.100619 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-caf9567d-162f-428d-b655-7db62b299f4f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:23.108905 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-caf9567d-162f-428d-b655-7db62b299f4f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:23.109414 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-caf9567d-162f-428d-b655-7db62b299f4f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:23.109845 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-caf9567d-162f-428d-b655-7db62b299f4f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:23.110575 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-caf9567d-162f-428d-b655-7db62b299f4f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:23.111028 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-caf9567d-162f-428d-b655-7db62b299f4f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:23.111455 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-caf9567d-162f-428d-b655-7db62b299f4f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:23.114117 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:23.145282 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-caf9567d-162f-428d-b655-7db62b299f4f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050660 Aug 26 11:09:23.145744 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 295/569] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:09:23 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:09:23.255531 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-558ece22-7331-466e-98b2-f27501352631 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:23.256483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-558ece22-7331-466e-98b2-f27501352631 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:23.266425 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-558ece22-7331-466e-98b2-f27501352631 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:23.267158 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-558ece22-7331-466e-98b2-f27501352631 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:23.267906 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-558ece22-7331-466e-98b2-f27501352631 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:23.269078 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-558ece22-7331-466e-98b2-f27501352631 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:23.269740 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-558ece22-7331-466e-98b2-f27501352631 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:23.270455 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-558ece22-7331-466e-98b2-f27501352631 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:23.291292 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:23.425752 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-558ece22-7331-466e-98b2-f27501352631 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:23.434942 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-558ece22-7331-466e-98b2-f27501352631 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:23.436388 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-558ece22-7331-466e-98b2-f27501352631 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:23.438117 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-558ece22-7331-466e-98b2-f27501352631 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1405 microversion: 2.20 time: 0.189056 Aug 26 11:09:23.439361 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 275/570] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:23 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:09:24.020038 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-44b0df6e-8079-4e4a-8a5d-eff1e0f9ce26 req-75d1858e-2a64-4f22-b462-4337d5fb20c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3983ebc-9955-4f0c-9ffd-0107d1a22723", "name": "network-vif-plugged", "status": "completed", "tag": "6d309e62-5a5f-4a29-b1a7-66190210585a"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:24.029583 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-44b0df6e-8079-4e4a-8a5d-eff1e0f9ce26 req-75d1858e-2a64-4f22-b462-4337d5fb20c2 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:24.030170 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-44b0df6e-8079-4e4a-8a5d-eff1e0f9ce26 req-75d1858e-2a64-4f22-b462-4337d5fb20c2 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:24.030597 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-44b0df6e-8079-4e4a-8a5d-eff1e0f9ce26 req-75d1858e-2a64-4f22-b462-4337d5fb20c2 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:24.043041 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-44b0df6e-8079-4e4a-8a5d-eff1e0f9ce26 req-75d1858e-2a64-4f22-b462-4337d5fb20c2 service nova] Creating event network-vif-plugged:6d309e62-5a5f-4a29-b1a7-66190210585a for instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 on hv-cinder-85236 Aug 26 11:09:24.049378 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-44b0df6e-8079-4e4a-8a5d-eff1e0f9ce26 req-75d1858e-2a64-4f22-b462-4337d5fb20c2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033352 Aug 26 11:09:24.049941 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 296/571] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:09:24.157842 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-25e67c8e-4f7b-4b13-b73d-28931f7bbe70 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:24.160103 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-25e67c8e-4f7b-4b13-b73d-28931f7bbe70 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:24.166427 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25e67c8e-4f7b-4b13-b73d-28931f7bbe70 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:24.166891 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25e67c8e-4f7b-4b13-b73d-28931f7bbe70 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:24.167330 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25e67c8e-4f7b-4b13-b73d-28931f7bbe70 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:24.168033 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25e67c8e-4f7b-4b13-b73d-28931f7bbe70 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:24.168484 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25e67c8e-4f7b-4b13-b73d-28931f7bbe70 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:24.168936 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25e67c8e-4f7b-4b13-b73d-28931f7bbe70 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:24.198491 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-25e67c8e-4f7b-4b13-b73d-28931f7bbe70 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045298 Aug 26 11:09:24.199059 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 276/572] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:09:24 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 11:09:24.291893 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-71687772-eb5f-4585-ad52-3d277423481f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:24.292725 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-71687772-eb5f-4585-ad52-3d277423481f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:24.299767 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-71687772-eb5f-4585-ad52-3d277423481f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:24.300245 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-71687772-eb5f-4585-ad52-3d277423481f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:24.300708 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-71687772-eb5f-4585-ad52-3d277423481f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:24.301424 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-71687772-eb5f-4585-ad52-3d277423481f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:24.301870 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-71687772-eb5f-4585-ad52-3d277423481f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:24.302310 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-71687772-eb5f-4585-ad52-3d277423481f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:24.330506 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-71687772-eb5f-4585-ad52-3d277423481f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Going to try to terminate instance {{(pid=120605) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:09:24.413812 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-71687772-eb5f-4585-ad52-3d277423481f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 204 len: 0 microversion: 2.1 time: 0.126043 Aug 26 11:09:24.414513 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 297/573] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:09:24 2022] DELETE /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:09:24.422766 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-caa47c73-774d-4d79-ac59-1975d2e8645e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:24.423385 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-caa47c73-774d-4d79-ac59-1975d2e8645e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:24.429847 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-caa47c73-774d-4d79-ac59-1975d2e8645e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:24.430360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-caa47c73-774d-4d79-ac59-1975d2e8645e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:24.430801 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-caa47c73-774d-4d79-ac59-1975d2e8645e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:24.431894 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-caa47c73-774d-4d79-ac59-1975d2e8645e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:24.432012 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-caa47c73-774d-4d79-ac59-1975d2e8645e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:24.432386 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-caa47c73-774d-4d79-ac59-1975d2e8645e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:24.462857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-53b1eade-1eac-44ed-821b-c9f782637e40 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:24.463548 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-53b1eade-1eac-44ed-821b-c9f782637e40 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:24.470729 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-53b1eade-1eac-44ed-821b-c9f782637e40 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:24.471293 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-53b1eade-1eac-44ed-821b-c9f782637e40 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:24.471726 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-53b1eade-1eac-44ed-821b-c9f782637e40 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:24.472473 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-53b1eade-1eac-44ed-821b-c9f782637e40 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:24.472918 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-53b1eade-1eac-44ed-821b-c9f782637e40 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:24.473337 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-53b1eade-1eac-44ed-821b-c9f782637e40 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:24.626908 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-caa47c73-774d-4d79-ac59-1975d2e8645e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:24.637091 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-caa47c73-774d-4d79-ac59-1975d2e8645e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1686 microversion: 2.1 time: 0.216843 Aug 26 11:09:24.638442 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 277/574] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:24 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1686 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:24.662199 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-53b1eade-1eac-44ed-821b-c9f782637e40 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:24.670662 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-53b1eade-1eac-44ed-821b-c9f782637e40 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:24.672297 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-53b1eade-1eac-44ed-821b-c9f782637e40 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:24.673403 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-53b1eade-1eac-44ed-821b-c9f782637e40 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1405 microversion: 2.20 time: 0.214802 Aug 26 11:09:24.673956 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 298/575] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:24 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:09:25.660065 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-16cb7d50-ca53-4eed-b586-3b3d8c1da925 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:25.660885 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-16cb7d50-ca53-4eed-b586-3b3d8c1da925 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:25.662773 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:25.663423 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=10 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:25.670165 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16cb7d50-ca53-4eed-b586-3b3d8c1da925 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:25.670647 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16cb7d50-ca53-4eed-b586-3b3d8c1da925 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:25.671087 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16cb7d50-ca53-4eed-b586-3b3d8c1da925 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:25.672370 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16cb7d50-ca53-4eed-b586-3b3d8c1da925 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:25.673134 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16cb7d50-ca53-4eed-b586-3b3d8c1da925 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:25.673679 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16cb7d50-ca53-4eed-b586-3b3d8c1da925 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:25.697091 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-75d0ed5b-8215-4185-ba49-f991a8f6f36c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:25.698053 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-75d0ed5b-8215-4185-ba49-f991a8f6f36c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:25.700002 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:25.707426 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75d0ed5b-8215-4185-ba49-f991a8f6f36c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:25.707911 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75d0ed5b-8215-4185-ba49-f991a8f6f36c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:25.708546 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75d0ed5b-8215-4185-ba49-f991a8f6f36c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:25.709263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75d0ed5b-8215-4185-ba49-f991a8f6f36c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:25.709725 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75d0ed5b-8215-4185-ba49-f991a8f6f36c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:25.710162 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75d0ed5b-8215-4185-ba49-f991a8f6f36c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:25.927618 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-16cb7d50-ca53-4eed-b586-3b3d8c1da925 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:25.937901 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-75d0ed5b-8215-4185-ba49-f991a8f6f36c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:25.938418 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-16cb7d50-ca53-4eed-b586-3b3d8c1da925 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1686 microversion: 2.1 time: 0.282247 Aug 26 11:09:25.939011 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 278/576] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:25 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1686 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:25.948739 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-75d0ed5b-8215-4185-ba49-f991a8f6f36c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:25.950242 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-75d0ed5b-8215-4185-ba49-f991a8f6f36c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:25.951370 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-75d0ed5b-8215-4185-ba49-f991a8f6f36c tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1405 microversion: 2.20 time: 0.258184 Aug 26 11:09:25.951927 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 299/577] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:25 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1405 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:09:26.966015 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9404ebbd-6886-4382-9acc-986c8130a6bf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:26.966577 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9404ebbd-6886-4382-9acc-986c8130a6bf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:26.974169 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9404ebbd-6886-4382-9acc-986c8130a6bf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:26.974774 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9404ebbd-6886-4382-9acc-986c8130a6bf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:26.975218 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9404ebbd-6886-4382-9acc-986c8130a6bf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:26.975926 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9404ebbd-6886-4382-9acc-986c8130a6bf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:26.976166 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-7dce3041-2d63-4cc9-beca-880aed8c4d0a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:26.976869 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9404ebbd-6886-4382-9acc-986c8130a6bf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:26.976869 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9404ebbd-6886-4382-9acc-986c8130a6bf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:26.978439 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-7dce3041-2d63-4cc9-beca-880aed8c4d0a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:26.988722 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7dce3041-2d63-4cc9-beca-880aed8c4d0a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:26.989225 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7dce3041-2d63-4cc9-beca-880aed8c4d0a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:26.989674 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7dce3041-2d63-4cc9-beca-880aed8c4d0a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:26.990434 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7dce3041-2d63-4cc9-beca-880aed8c4d0a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:26.990890 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7dce3041-2d63-4cc9-beca-880aed8c4d0a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:26.991362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7dce3041-2d63-4cc9-beca-880aed8c4d0a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:27.206049 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9404ebbd-6886-4382-9acc-986c8130a6bf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:27.211164 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7dce3041-2d63-4cc9-beca-880aed8c4d0a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:27.214477 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9404ebbd-6886-4382-9acc-986c8130a6bf tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1686 microversion: 2.1 time: 0.252518 Aug 26 11:09:27.215430 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 279/578] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:26 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1686 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:27.221446 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7dce3041-2d63-4cc9-beca-880aed8c4d0a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:27.222849 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7dce3041-2d63-4cc9-beca-880aed8c4d0a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:27.223954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-7dce3041-2d63-4cc9-beca-880aed8c4d0a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1405 microversion: 2.20 time: 0.253503 Aug 26 11:09:27.224504 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 300/579] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:26 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1405 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:09:28.239527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5f79779f-1001-4045-a276-1699075c026a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:28.240546 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5f79779f-1001-4045-a276-1699075c026a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:28.247857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-7d44c999-42e3-4c27-92ce-c172c977b226 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:28.248921 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-7d44c999-42e3-4c27-92ce-c172c977b226 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:28.250079 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f79779f-1001-4045-a276-1699075c026a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:28.250890 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f79779f-1001-4045-a276-1699075c026a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:28.251674 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f79779f-1001-4045-a276-1699075c026a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:28.252758 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f79779f-1001-4045-a276-1699075c026a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:28.254071 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f79779f-1001-4045-a276-1699075c026a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:28.254585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f79779f-1001-4045-a276-1699075c026a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:28.257210 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d44c999-42e3-4c27-92ce-c172c977b226 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:28.257705 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d44c999-42e3-4c27-92ce-c172c977b226 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:28.258202 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d44c999-42e3-4c27-92ce-c172c977b226 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:28.258913 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d44c999-42e3-4c27-92ce-c172c977b226 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:28.259374 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d44c999-42e3-4c27-92ce-c172c977b226 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:28.259794 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7d44c999-42e3-4c27-92ce-c172c977b226 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:28.486628 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5f79779f-1001-4045-a276-1699075c026a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:28.494637 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7d44c999-42e3-4c27-92ce-c172c977b226 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:28.501360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5f79779f-1001-4045-a276-1699075c026a tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1686 microversion: 2.1 time: 0.267897 Aug 26 11:09:28.502359 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 280/580] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:28 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1686 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:28.507832 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7d44c999-42e3-4c27-92ce-c172c977b226 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:28.509651 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7d44c999-42e3-4c27-92ce-c172c977b226 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:28.511069 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-7d44c999-42e3-4c27-92ce-c172c977b226 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1405 microversion: 2.20 time: 0.268028 Aug 26 11:09:28.511824 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 301/581] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:28 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:09:29.531624 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-85430e6c-b9b1-4c62-afd5-5075795d53e1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:29.532539 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-85430e6c-b9b1-4c62-afd5-5075795d53e1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:29.537202 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-207f4b57-a51e-465d-84c0-649129ee03f6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:29.537802 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-207f4b57-a51e-465d-84c0-649129ee03f6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:29.539648 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85430e6c-b9b1-4c62-afd5-5075795d53e1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:29.540138 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85430e6c-b9b1-4c62-afd5-5075795d53e1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:29.544479 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85430e6c-b9b1-4c62-afd5-5075795d53e1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:29.545066 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-207f4b57-a51e-465d-84c0-649129ee03f6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:29.545300 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85430e6c-b9b1-4c62-afd5-5075795d53e1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:29.545561 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-207f4b57-a51e-465d-84c0-649129ee03f6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:29.545785 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85430e6c-b9b1-4c62-afd5-5075795d53e1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:29.546009 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-207f4b57-a51e-465d-84c0-649129ee03f6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:29.546402 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85430e6c-b9b1-4c62-afd5-5075795d53e1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:29.547215 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-207f4b57-a51e-465d-84c0-649129ee03f6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:29.547660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-207f4b57-a51e-465d-84c0-649129ee03f6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:29.548077 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-207f4b57-a51e-465d-84c0-649129ee03f6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:29.753804 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-207f4b57-a51e-465d-84c0-649129ee03f6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:29.757765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-85430e6c-b9b1-4c62-afd5-5075795d53e1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:29.762289 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-207f4b57-a51e-465d-84c0-649129ee03f6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:29.763811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-207f4b57-a51e-465d-84c0-649129ee03f6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:29.764944 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-207f4b57-a51e-465d-84c0-649129ee03f6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1405 microversion: 2.20 time: 0.231626 Aug 26 11:09:29.767105 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 302/582] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:29 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1405 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:09:29.767242 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-85430e6c-b9b1-4c62-afd5-5075795d53e1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1686 microversion: 2.1 time: 0.238080 Aug 26 11:09:29.767350 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 281/583] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:29 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1686 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:30.788138 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6815d89d-8cfb-46ac-a7c5-35839c16237e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:30.788783 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0e5df91d-dbc0-45ad-a3c8-406759efa607 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:30.789191 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6815d89d-8cfb-46ac-a7c5-35839c16237e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:30.789297 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0e5df91d-dbc0-45ad-a3c8-406759efa607 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:30.795416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0e5df91d-dbc0-45ad-a3c8-406759efa607 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:30.795586 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6815d89d-8cfb-46ac-a7c5-35839c16237e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:30.795902 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0e5df91d-dbc0-45ad-a3c8-406759efa607 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:30.796030 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6815d89d-8cfb-46ac-a7c5-35839c16237e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:30.796337 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0e5df91d-dbc0-45ad-a3c8-406759efa607 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:30.796441 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6815d89d-8cfb-46ac-a7c5-35839c16237e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:30.797092 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6815d89d-8cfb-46ac-a7c5-35839c16237e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:30.797269 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0e5df91d-dbc0-45ad-a3c8-406759efa607 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:30.797548 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6815d89d-8cfb-46ac-a7c5-35839c16237e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:30.797911 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0e5df91d-dbc0-45ad-a3c8-406759efa607 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:30.798041 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6815d89d-8cfb-46ac-a7c5-35839c16237e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:30.798364 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0e5df91d-dbc0-45ad-a3c8-406759efa607 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:30.997865 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0e5df91d-dbc0-45ad-a3c8-406759efa607 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:31.001735 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6815d89d-8cfb-46ac-a7c5-35839c16237e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:31.006833 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0e5df91d-dbc0-45ad-a3c8-406759efa607 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1686 microversion: 2.1 time: 0.222545 Aug 26 11:09:31.007504 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 303/584] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:30 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1686 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:31.010337 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6815d89d-8cfb-46ac-a7c5-35839c16237e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:31.011783 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6815d89d-8cfb-46ac-a7c5-35839c16237e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:31.012887 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6815d89d-8cfb-46ac-a7c5-35839c16237e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1405 microversion: 2.20 time: 0.228691 Aug 26 11:09:31.013430 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 282/585] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:30 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:09:31.381689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3f14062b-47aa-4d36-a2cf-77ff5c4aea88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-640556961"}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:31.382257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-3f14062b-47aa-4d36-a2cf-77ff5c4aea88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:31.388384 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3f14062b-47aa-4d36-a2cf-77ff5c4aea88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:31.388874 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3f14062b-47aa-4d36-a2cf-77ff5c4aea88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:31.389311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3f14062b-47aa-4d36-a2cf-77ff5c4aea88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:31.390040 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3f14062b-47aa-4d36-a2cf-77ff5c4aea88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:31.391279 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3f14062b-47aa-4d36-a2cf-77ff5c4aea88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:31.391844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3f14062b-47aa-4d36-a2cf-77ff5c4aea88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:31.523211 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.network.security_group_api [None req-3f14062b-47aa-4d36-a2cf-77ff5c4aea88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Removing security group 371b7b01-26df-414a-8083-afc5a769decd from port 9431c858-ac93-4f2b-a673-fd8e539b68c8 Aug 26 11:09:31.851774 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-3f14062b-47aa-4d36-a2cf-77ff5c4aea88 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "POST /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/action" status: 202 len: 0 microversion: 2.1 time: 0.474147 Aug 26 11:09:31.865703 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 304/586] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 11:09:31 2022] POST /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:09:31.885564 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-ecc625ec-efa8-4fbf-87d5-acec4c16b44f req-314c4a8a-18b8-4b97-b428-c4a80ed8d042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136f48c9-a521-4bc3-b6cc-98da91d02c49", "tag": "9431c858-ac93-4f2b-a673-fd8e539b68c8"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:31.897396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-ecc625ec-efa8-4fbf-87d5-acec4c16b44f req-314c4a8a-18b8-4b97-b428-c4a80ed8d042 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:31.897882 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-ecc625ec-efa8-4fbf-87d5-acec4c16b44f req-314c4a8a-18b8-4b97-b428-c4a80ed8d042 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:31.898344 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-ecc625ec-efa8-4fbf-87d5-acec4c16b44f req-314c4a8a-18b8-4b97-b428-c4a80ed8d042 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:31.912688 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-ecc625ec-efa8-4fbf-87d5-acec4c16b44f req-314c4a8a-18b8-4b97-b428-c4a80ed8d042 service nova] Creating event network-changed:9431c858-ac93-4f2b-a673-fd8e539b68c8 for instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 on hv-cinder-85236 Aug 26 11:09:31.928966 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-ecc625ec-efa8-4fbf-87d5-acec4c16b44f req-314c4a8a-18b8-4b97-b428-c4a80ed8d042 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047512 Aug 26 11:09:31.931066 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 283/587] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:09:32.030069 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-003b712b-dafa-4f27-aa37-04a25c15210c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:32.037027 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-30a07b27-cc71-4018-8ac8-8331e5be1479 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:32.038428 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-003b712b-dafa-4f27-aa37-04a25c15210c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:32.041212 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-30a07b27-cc71-4018-8ac8-8331e5be1479 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:32.051868 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-30a07b27-cc71-4018-8ac8-8331e5be1479 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:32.052368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-30a07b27-cc71-4018-8ac8-8331e5be1479 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:32.052807 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-30a07b27-cc71-4018-8ac8-8331e5be1479 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:32.054788 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-003b712b-dafa-4f27-aa37-04a25c15210c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:32.055276 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-003b712b-dafa-4f27-aa37-04a25c15210c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:32.058809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-003b712b-dafa-4f27-aa37-04a25c15210c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:32.058809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-003b712b-dafa-4f27-aa37-04a25c15210c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:32.058809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-003b712b-dafa-4f27-aa37-04a25c15210c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:32.058809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-003b712b-dafa-4f27-aa37-04a25c15210c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:32.059603 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-30a07b27-cc71-4018-8ac8-8331e5be1479 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:32.060089 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-30a07b27-cc71-4018-8ac8-8331e5be1479 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:32.061211 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-30a07b27-cc71-4018-8ac8-8331e5be1479 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:32.430413 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-003b712b-dafa-4f27-aa37-04a25c15210c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:32.440126 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-003b712b-dafa-4f27-aa37-04a25c15210c tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1686 microversion: 2.1 time: 0.414819 Aug 26 11:09:32.441191 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 305/588] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:32 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1686 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:32.454180 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-30a07b27-cc71-4018-8ac8-8331e5be1479 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:32.463121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-30a07b27-cc71-4018-8ac8-8331e5be1479 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:32.464975 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-30a07b27-cc71-4018-8ac8-8331e5be1479 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:32.466319 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-30a07b27-cc71-4018-8ac8-8331e5be1479 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1405 microversion: 2.20 time: 0.433893 Aug 26 11:09:32.466878 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 284/589] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:32 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:09:33.157802 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5fc4a1a5-895a-4926-b579-747f160f8007 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:33.158365 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5fc4a1a5-895a-4926-b579-747f160f8007 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:33.164924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5fc4a1a5-895a-4926-b579-747f160f8007 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:33.165493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5fc4a1a5-895a-4926-b579-747f160f8007 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:33.165952 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5fc4a1a5-895a-4926-b579-747f160f8007 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:33.166688 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5fc4a1a5-895a-4926-b579-747f160f8007 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:33.167141 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5fc4a1a5-895a-4926-b579-747f160f8007 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:33.167722 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5fc4a1a5-895a-4926-b579-747f160f8007 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:33.276493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-5fc4a1a5-895a-4926-b579-747f160f8007 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lazy-loading 'services' on Instance uuid 136f48c9-a521-4bc3-b6cc-98da91d02c49 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:09:33.319472 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-bb1eec74-84e4-47b3-bda4-fc9247b00b66 req-8f55e387-5c6f-4cb7-926c-c3f4e5621943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9530d01a-c2a4-44f2-a631-31faa3921205", "name": "network-vif-deleted", "tag": "4641460f-7920-49e5-b889-55969872b7b8"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:33.373465 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-bb1eec74-84e4-47b3-bda4-fc9247b00b66 req-8f55e387-5c6f-4cb7-926c-c3f4e5621943 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:33.375025 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-bb1eec74-84e4-47b3-bda4-fc9247b00b66 req-8f55e387-5c6f-4cb7-926c-c3f4e5621943 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:33.376474 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-bb1eec74-84e4-47b3-bda4-fc9247b00b66 req-8f55e387-5c6f-4cb7-926c-c3f4e5621943 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:33.391824 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-bb1eec74-84e4-47b3-bda4-fc9247b00b66 req-8f55e387-5c6f-4cb7-926c-c3f4e5621943 service nova] Creating event network-vif-deleted:4641460f-7920-49e5-b889-55969872b7b8 for instance 9530d01a-c2a4-44f2-a631-31faa3921205 on hv-cinder-85236 Aug 26 11:09:33.401612 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-bb1eec74-84e4-47b3-bda4-fc9247b00b66 req-8f55e387-5c6f-4cb7-926c-c3f4e5621943 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085825 Aug 26 11:09:33.403129 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 285/590] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:09:33.465959 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c6c0ffd4-8faa-486c-bc33-cb68db2478c8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:33.466705 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c6c0ffd4-8faa-486c-bc33-cb68db2478c8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:33.481955 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c6c0ffd4-8faa-486c-bc33-cb68db2478c8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:33.482617 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c6c0ffd4-8faa-486c-bc33-cb68db2478c8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:33.483072 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c6c0ffd4-8faa-486c-bc33-cb68db2478c8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:33.488680 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c6c0ffd4-8faa-486c-bc33-cb68db2478c8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:33.489117 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5fc4a1a5-895a-4926-b579-747f160f8007 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/os-volume_attachments/74cd7644-d6d9-4677-afdc-f779f29fa6c8" status: 202 len: 0 microversion: 2.1 time: 0.335893 Aug 26 11:09:33.489919 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 306/591] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 11:09:33 2022] DELETE /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/os-volume_attachments/74cd7644-d6d9-4677-afdc-f779f29fa6c8 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:09:33.490144 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c6c0ffd4-8faa-486c-bc33-cb68db2478c8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:33.492296 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c6c0ffd4-8faa-486c-bc33-cb68db2478c8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:33.505352 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f3ab4099-5a8d-4a42-bee9-2f67e16b5801 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:33.508929 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f3ab4099-5a8d-4a42-bee9-2f67e16b5801 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:33.526986 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f3ab4099-5a8d-4a42-bee9-2f67e16b5801 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:33.527922 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f3ab4099-5a8d-4a42-bee9-2f67e16b5801 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:33.533057 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f3ab4099-5a8d-4a42-bee9-2f67e16b5801 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:33.534134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f3ab4099-5a8d-4a42-bee9-2f67e16b5801 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:33.534835 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f3ab4099-5a8d-4a42-bee9-2f67e16b5801 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:33.535489 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f3ab4099-5a8d-4a42-bee9-2f67e16b5801 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:33.710909 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c6c0ffd4-8faa-486c-bc33-cb68db2478c8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:33.721928 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c6c0ffd4-8faa-486c-bc33-cb68db2478c8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1329 microversion: 2.1 time: 0.260639 Aug 26 11:09:33.734012 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 286/592] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:33 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1329 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:33.734012 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4b72c716-140b-4c96-afec-0c8054bbe3b0 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:33.734012 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4b72c716-140b-4c96-afec-0c8054bbe3b0 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:33.739949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b72c716-140b-4c96-afec-0c8054bbe3b0 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:33.740944 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b72c716-140b-4c96-afec-0c8054bbe3b0 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:33.741672 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b72c716-140b-4c96-afec-0c8054bbe3b0 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:33.742652 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b72c716-140b-4c96-afec-0c8054bbe3b0 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:33.743777 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b72c716-140b-4c96-afec-0c8054bbe3b0 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:33.744436 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b72c716-140b-4c96-afec-0c8054bbe3b0 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:33.787662 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4b72c716-140b-4c96-afec-0c8054bbe3b0 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063200 Aug 26 11:09:33.789134 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 287/593] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:09:33 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:09:33.867588 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f3ab4099-5a8d-4a42-bee9-2f67e16b5801 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:33.880127 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f3ab4099-5a8d-4a42-bee9-2f67e16b5801 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:33.881606 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f3ab4099-5a8d-4a42-bee9-2f67e16b5801 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:33.882988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f3ab4099-5a8d-4a42-bee9-2f67e16b5801 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1597 microversion: 2.20 time: 0.389205 Aug 26 11:09:33.883728 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 307/594] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:09:33 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1597 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:09:33.906257 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ea04bd8e-801f-4e59-87ff-9ccb7bdd31d6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:33.907037 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ea04bd8e-801f-4e59-87ff-9ccb7bdd31d6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:33.913002 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ea04bd8e-801f-4e59-87ff-9ccb7bdd31d6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:33.913496 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ea04bd8e-801f-4e59-87ff-9ccb7bdd31d6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:33.913934 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ea04bd8e-801f-4e59-87ff-9ccb7bdd31d6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:33.914670 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ea04bd8e-801f-4e59-87ff-9ccb7bdd31d6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:33.915124 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ea04bd8e-801f-4e59-87ff-9ccb7bdd31d6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:33.915741 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ea04bd8e-801f-4e59-87ff-9ccb7bdd31d6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:33.947756 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-94b0ba7b-c490-4561-879f-7514d4b020e2 req-5ae3c91f-d089-4366-bfe6-d49b7ec4eb0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136f48c9-a521-4bc3-b6cc-98da91d02c49", "tag": "9431c858-ac93-4f2b-a673-fd8e539b68c8"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:33.961916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-94b0ba7b-c490-4561-879f-7514d4b020e2 req-5ae3c91f-d089-4366-bfe6-d49b7ec4eb0d service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:33.962415 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-94b0ba7b-c490-4561-879f-7514d4b020e2 req-5ae3c91f-d089-4366-bfe6-d49b7ec4eb0d service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:33.963193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-94b0ba7b-c490-4561-879f-7514d4b020e2 req-5ae3c91f-d089-4366-bfe6-d49b7ec4eb0d service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:33.976759 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-94b0ba7b-c490-4561-879f-7514d4b020e2 req-5ae3c91f-d089-4366-bfe6-d49b7ec4eb0d service nova] Creating event network-changed:9431c858-ac93-4f2b-a673-fd8e539b68c8 for instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 on hv-cinder-85236 Aug 26 11:09:33.982334 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-94b0ba7b-c490-4561-879f-7514d4b020e2 req-5ae3c91f-d089-4366-bfe6-d49b7ec4eb0d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038107 Aug 26 11:09:33.983505 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 308/595] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:09:34.005585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ea04bd8e-801f-4e59-87ff-9ccb7bdd31d6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103580 Aug 26 11:09:34.008816 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 288/596] 10.222.0.40 () {60 vars in 1316 bytes} [Fri Aug 26 11:09:33 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 11:09:34.751160 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-bffa6384-b8db-48af-9688-900a4495a81d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:34.752691 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-bffa6384-b8db-48af-9688-900a4495a81d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:34.760230 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bffa6384-b8db-48af-9688-900a4495a81d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:34.761782 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bffa6384-b8db-48af-9688-900a4495a81d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:34.762673 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bffa6384-b8db-48af-9688-900a4495a81d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:34.763587 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bffa6384-b8db-48af-9688-900a4495a81d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:34.764208 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bffa6384-b8db-48af-9688-900a4495a81d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:34.764833 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bffa6384-b8db-48af-9688-900a4495a81d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:34.806277 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4affb359-438f-4393-848e-84655a852889 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:34.810298 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4affb359-438f-4393-848e-84655a852889 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:34.816348 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bffa6384-b8db-48af-9688-900a4495a81d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:34.816851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bffa6384-b8db-48af-9688-900a4495a81d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:34.817343 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bffa6384-b8db-48af-9688-900a4495a81d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:34.818113 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-bffa6384-b8db-48af-9688-900a4495a81d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lazy-loading 'fault' on Instance uuid 9530d01a-c2a4-44f2-a631-31faa3921205 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:09:34.818252 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4affb359-438f-4393-848e-84655a852889 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:34.822788 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4affb359-438f-4393-848e-84655a852889 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:34.823353 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4affb359-438f-4393-848e-84655a852889 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:34.824170 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4affb359-438f-4393-848e-84655a852889 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:34.824639 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4affb359-438f-4393-848e-84655a852889 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:34.825072 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4affb359-438f-4393-848e-84655a852889 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:34.889044 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-bffa6384-b8db-48af-9688-900a4495a81d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:34.900502 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4affb359-438f-4393-848e-84655a852889 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102543 Aug 26 11:09:34.900792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-bffa6384-b8db-48af-9688-900a4495a81d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 200 len: 1334 microversion: 2.1 time: 0.155538 Aug 26 11:09:34.902021 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 289/597] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:09:34 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 11:09:34.902302 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 309/598] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:34 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 1334 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:34.926033 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f03270b9-ddb6-4e78-94b9-dfe762571932 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:34.926527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f03270b9-ddb6-4e78-94b9-dfe762571932 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:34.932872 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f03270b9-ddb6-4e78-94b9-dfe762571932 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:34.933359 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f03270b9-ddb6-4e78-94b9-dfe762571932 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:34.934008 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f03270b9-ddb6-4e78-94b9-dfe762571932 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:34.934737 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f03270b9-ddb6-4e78-94b9-dfe762571932 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:34.935197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f03270b9-ddb6-4e78-94b9-dfe762571932 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:34.935618 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f03270b9-ddb6-4e78-94b9-dfe762571932 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:35.024782 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-f03270b9-ddb6-4e78-94b9-dfe762571932 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] HTTP exception thrown: Instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 is not attached to volume 74cd7644-d6d9-4677-afdc-f779f29fa6c8 Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f03270b9-ddb6-4e78-94b9-dfe762571932 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Request method failure captured: Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: DELETE /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/os-volume_attachments/74cd7644-d6d9-4677-afdc-f779f29fa6c8 HTTP/1.1 Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKk0iDbLPmDpSYj37c5d3HI3sZcyqBdOjj7_9DoW2QGe6Jd7BZ1Z5UdyS1lxfH1jDzpp-hBco38EmpN0vzIBPeBTsYRNVINNlUo8gr4SJa75Z_PKYkdx5lcjkKZmaGDF2DPGwUVYTxdS5oxdjqscwmjabqe-xHJ3-Akheo6R7M-gotA Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: 9483fc8d1764471b99c49e4ee46c0b12 Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-TestMinimumBasicScenario-1692263360 Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:09:35.027742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:09:35.029105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9483fc8d1764471b99c49e4ee46c0b12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9483fc8d1764471b99c49e4ee46c0b12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9483fc8d1764471b99c49e4ee46c0b12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9483fc8d1764471b99c49e4ee46c0b12"}]}] Aug 26 11:09:35.029105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-TestMinimumBasicScenario-1692263360 Aug 26 11:09:35.029105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 9483fc8d1764471b99c49e4ee46c0b12 Aug 26 11:09:35.029105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1692263360 Aug 26 11:09:35.029105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-TestMinimumBasicScenario-1692263360-project Aug 26 11:09:35.029105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:09:35.029105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:09:35.029105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: be8fb67568674d0b91424e2a16407539 Aug 26 11:09:35.029105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-TestMinimumBasicScenario-1692263360-project Aug 26 11:09:35.029105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:09:35.029105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 is not attached to volume 74cd7644-d6d9-4677-afdc-f779f29fa6c8 Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'server_id': '136f48c9-a521-4bc3-b6cc-98da91d02c49', 'id': '74cd7644-d6d9-4677-afdc-f779f29fa6c8'} Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 74cd7644-d6d9-4677-afdc-f779f29fa6c8. Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:09:35.029805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:09:35.031543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:09:35.031543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 26 11:09:35.031543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 26 11:09:35.031543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 is not attached to volume 74cd7644-d6d9-4677-afdc-f779f29fa6c8 Aug 26 11:09:35.031543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:35.031543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:09:35.031543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:35.031543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:35.031543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:09:35.031543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:09:35.031543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:09:35.031543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:09:35.031543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 is not attached to volume 74cd7644-d6d9-4677-afdc-f779f29fa6c8 Aug 26 11:09:35.031543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:35.031543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f03270b9-ddb6-4e78-94b9-dfe762571932 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Returning 404 to user: Instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 is not attached to volume 74cd7644-d6d9-4677-afdc-f779f29fa6c8 {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:09:35.032571 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f03270b9-ddb6-4e78-94b9-dfe762571932 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/os-volume_attachments/74cd7644-d6d9-4677-afdc-f779f29fa6c8" status: 404 len: 154 microversion: 2.1 time: 0.108213 Aug 26 11:09:35.032571 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 290/599] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 11:09:34 2022] DELETE /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49/os-volume_attachments/74cd7644-d6d9-4677-afdc-f779f29fa6c8 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:09:35.689947 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-aff56261-a72a-4c25-9a7b-5b3a5fda3604 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:35.690588 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-aff56261-a72a-4c25-9a7b-5b3a5fda3604 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:35.696821 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aff56261-a72a-4c25-9a7b-5b3a5fda3604 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:35.697605 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aff56261-a72a-4c25-9a7b-5b3a5fda3604 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:35.698197 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aff56261-a72a-4c25-9a7b-5b3a5fda3604 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:35.698917 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aff56261-a72a-4c25-9a7b-5b3a5fda3604 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:35.699373 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aff56261-a72a-4c25-9a7b-5b3a5fda3604 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:35.699796 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aff56261-a72a-4c25-9a7b-5b3a5fda3604 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:35.781927 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:35.788362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-aff56261-a72a-4c25-9a7b-5b3a5fda3604 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lazy-loading 'services' on Instance uuid aca6ba27-f52a-4bcb-9e67-d09645be0b19 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:09:35.852725 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-e2440e4e-d83e-456d-9239-4bac11c0ed69 req-039aff1c-2b85-4bdf-9128-5ac5e2346288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3983ebc-9955-4f0c-9ffd-0107d1a22723", "tag": "6d309e62-5a5f-4a29-b1a7-66190210585a"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:35.864061 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e2440e4e-d83e-456d-9239-4bac11c0ed69 req-039aff1c-2b85-4bdf-9128-5ac5e2346288 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:35.864061 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e2440e4e-d83e-456d-9239-4bac11c0ed69 req-039aff1c-2b85-4bdf-9128-5ac5e2346288 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:35.864429 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e2440e4e-d83e-456d-9239-4bac11c0ed69 req-039aff1c-2b85-4bdf-9128-5ac5e2346288 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:35.878406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-e2440e4e-d83e-456d-9239-4bac11c0ed69 req-039aff1c-2b85-4bdf-9128-5ac5e2346288 service nova] Creating event network-changed:6d309e62-5a5f-4a29-b1a7-66190210585a for instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 on hv-cinder-85236 Aug 26 11:09:35.884062 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-e2440e4e-d83e-456d-9239-4bac11c0ed69 req-039aff1c-2b85-4bdf-9128-5ac5e2346288 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034909 Aug 26 11:09:35.888923 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 291/600] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:09:35.893669 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-aff56261-a72a-4c25-9a7b-5b3a5fda3604 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "DELETE /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19/os-volume_attachments/35763f0d-c915-4586-9972-cef9b19aad94" status: 202 len: 0 microversion: 2.1 time: 0.207880 Aug 26 11:09:35.895156 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 310/601] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 11:09:35 2022] DELETE /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19/os-volume_attachments/35763f0d-c915-4586-9972-cef9b19aad94 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:09:35.934110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d788ab57-898c-41b6-af80-26ce77a21df4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:35.934837 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d788ab57-898c-41b6-af80-26ce77a21df4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: 9530d01a-c2a4-44f2-a631-31faa3921205] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:35.956149 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d788ab57-898c-41b6-af80-26ce77a21df4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:35.956691 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d788ab57-898c-41b6-af80-26ce77a21df4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:35.957141 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d788ab57-898c-41b6-af80-26ce77a21df4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:35.957867 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d788ab57-898c-41b6-af80-26ce77a21df4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:35.974990 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d788ab57-898c-41b6-af80-26ce77a21df4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:35.990750 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d788ab57-898c-41b6-af80-26ce77a21df4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:36.032683 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-d788ab57-898c-41b6-af80-26ce77a21df4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] HTTP exception thrown: Instance 9530d01a-c2a4-44f2-a631-31faa3921205 could not be found. Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d788ab57-898c-41b6-af80-26ce77a21df4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Request method failure captured: Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 HTTP/1.1 Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKjKoFWt_mGTxQc01qKCjXUDq7iYUfd7QeRZ0zpT5eoQIJBk_9LMauXMlsoKUf_7HcU9hxiDc2CZHgZUc6PoeUKDo4e4ygyUFdoUFueMawN06Zy51crBpM09ad2MKRCu2-vRhJQ6qXBCPYLTkAj0OO2mr6xCjOndICFG1gqY_Xj_h7k Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: 7db3b983562e49cfbb77c9e64b6e6cb9 Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-818754082 Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:09:36.036537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:09:36.037856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7db3b983562e49cfbb77c9e64b6e6cb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7db3b983562e49cfbb77c9e64b6e6cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7db3b983562e49cfbb77c9e64b6e6cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7db3b983562e49cfbb77c9e64b6e6cb9"}]}] Aug 26 11:09:36.037856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-ServerRescueNegativeTestJSON-818754082 Aug 26 11:09:36.037856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 7db3b983562e49cfbb77c9e64b6e6cb9 Aug 26 11:09:36.037856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-818754082 Aug 26 11:09:36.037856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-ServerRescueNegativeTestJSON-818754082-project Aug 26 11:09:36.037856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:09:36.037856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:09:36.037856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: d6dbbabdd88c4c088bc91e6c43531318 Aug 26 11:09:36.037856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-ServerRescueNegativeTestJSON-818754082-project Aug 26 11:09:36.037856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:09:36.037856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance 9530d01a-c2a4-44f2-a631-31faa3921205 could not be found. Aug 26 11:09:36.037856 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': '9530d01a-c2a4-44f2-a631-31faa3921205'} Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9530d01a-c2a4-44f2-a631-31faa3921205 could not be found. Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:09:36.038611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9530d01a-c2a4-44f2-a631-31faa3921205 could not be found. Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9530d01a-c2a4-44f2-a631-31faa3921205 could not be found. Aug 26 11:09:36.039765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:36.042241 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d788ab57-898c-41b6-af80-26ce77a21df4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Returning 404 to user: Instance 9530d01a-c2a4-44f2-a631-31faa3921205 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:09:36.043480 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d788ab57-898c-41b6-af80-26ce77a21df4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205" status: 404 len: 111 microversion: 2.1 time: 0.120017 Aug 26 11:09:36.044217 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 292/602] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:35 2022] GET /compute/v2.1/servers/9530d01a-c2a4-44f2-a631-31faa3921205 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:09:36.054083 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5995db96-1be1-4487-9c2c-b3a3747d2d00 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '.version_select at 0x7f1a6886eb80>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:36.091369 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5995db96-1be1-4487-9c2c-b3a3747d2d00 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-544214292" status: 202 len: 0 microversion: 2.1 time: 0.041618 Aug 26 11:09:36.092333 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 311/603] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 26 11:09:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-544214292 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 11:09:36.205596 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9d60c8bd-ba95-4bdb-acff-e1c5fad77a23 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:36.206927 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9d60c8bd-ba95-4bdb-acff-e1c5fad77a23 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:36.213949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d60c8bd-ba95-4bdb-acff-e1c5fad77a23 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:36.214838 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d60c8bd-ba95-4bdb-acff-e1c5fad77a23 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:36.215560 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d60c8bd-ba95-4bdb-acff-e1c5fad77a23 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:36.216504 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d60c8bd-ba95-4bdb-acff-e1c5fad77a23 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:36.217403 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d60c8bd-ba95-4bdb-acff-e1c5fad77a23 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:36.218340 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d60c8bd-ba95-4bdb-acff-e1c5fad77a23 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:36.248731 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9d60c8bd-ba95-4bdb-acff-e1c5fad77a23 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:09:36.308111 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:36.354340 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9d60c8bd-ba95-4bdb-acff-e1c5fad77a23 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "DELETE /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 204 len: 0 microversion: 2.1 time: 0.154246 Aug 26 11:09:36.354997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 293/604] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:09:36 2022] DELETE /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 11:09:36.365265 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-76579913-1575-4a78-bb23-2bc39bda58af tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:36.366427 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-76579913-1575-4a78-bb23-2bc39bda58af tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:36.373100 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-76579913-1575-4a78-bb23-2bc39bda58af tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:36.373725 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-76579913-1575-4a78-bb23-2bc39bda58af tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:36.374293 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-76579913-1575-4a78-bb23-2bc39bda58af tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:36.375805 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-76579913-1575-4a78-bb23-2bc39bda58af tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:36.376636 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-76579913-1575-4a78-bb23-2bc39bda58af tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:36.377139 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-76579913-1575-4a78-bb23-2bc39bda58af tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:36.595833 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-76579913-1575-4a78-bb23-2bc39bda58af tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:36.603872 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-76579913-1575-4a78-bb23-2bc39bda58af tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1552 microversion: 2.1 time: 0.243191 Aug 26 11:09:36.604679 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 312/605] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:36 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1552 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:37.627269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e93cd8c3-a07b-45f1-99ee-b67dfe0e8844 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:37.627946 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e93cd8c3-a07b-45f1-99ee-b67dfe0e8844 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:37.634398 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e93cd8c3-a07b-45f1-99ee-b67dfe0e8844 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:37.634887 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e93cd8c3-a07b-45f1-99ee-b67dfe0e8844 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:37.635328 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e93cd8c3-a07b-45f1-99ee-b67dfe0e8844 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:37.636028 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e93cd8c3-a07b-45f1-99ee-b67dfe0e8844 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:37.636482 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e93cd8c3-a07b-45f1-99ee-b67dfe0e8844 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:37.636913 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e93cd8c3-a07b-45f1-99ee-b67dfe0e8844 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:37.775980 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e93cd8c3-a07b-45f1-99ee-b67dfe0e8844 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:37.784378 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e93cd8c3-a07b-45f1-99ee-b67dfe0e8844 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1552 microversion: 2.1 time: 0.162074 Aug 26 11:09:37.784946 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 294/606] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:37 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:38.804828 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-6863281a-a3d2-47be-995c-5d560d2b6fad tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:38.805442 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-6863281a-a3d2-47be-995c-5d560d2b6fad tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:38.807968 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:38.813861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6863281a-a3d2-47be-995c-5d560d2b6fad tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:38.814383 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6863281a-a3d2-47be-995c-5d560d2b6fad tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:38.814826 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6863281a-a3d2-47be-995c-5d560d2b6fad tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:38.815536 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6863281a-a3d2-47be-995c-5d560d2b6fad tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:38.815993 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6863281a-a3d2-47be-995c-5d560d2b6fad tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:38.816420 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6863281a-a3d2-47be-995c-5d560d2b6fad tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:38.947595 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6863281a-a3d2-47be-995c-5d560d2b6fad tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:38.955410 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-6863281a-a3d2-47be-995c-5d560d2b6fad tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1552 microversion: 2.1 time: 0.154483 Aug 26 11:09:38.955989 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 313/607] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:38 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:39.144672 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-47884312-3dd6-48c5-babc-e492aec3816d req-5498d18f-92da-4183-83f4-a1196ce23eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136f48c9-a521-4bc3-b6cc-98da91d02c49", "name": "network-vif-deleted", "tag": "9431c858-ac93-4f2b-a673-fd8e539b68c8"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:39.155239 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-47884312-3dd6-48c5-babc-e492aec3816d req-5498d18f-92da-4183-83f4-a1196ce23eba service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:39.155723 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-47884312-3dd6-48c5-babc-e492aec3816d req-5498d18f-92da-4183-83f4-a1196ce23eba service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:39.156716 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-47884312-3dd6-48c5-babc-e492aec3816d req-5498d18f-92da-4183-83f4-a1196ce23eba service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:39.168861 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-47884312-3dd6-48c5-babc-e492aec3816d req-5498d18f-92da-4183-83f4-a1196ce23eba service nova] Creating event network-vif-deleted:9431c858-ac93-4f2b-a673-fd8e539b68c8 for instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 on hv-cinder-85236 Aug 26 11:09:39.173775 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-47884312-3dd6-48c5-babc-e492aec3816d req-5498d18f-92da-4183-83f4-a1196ce23eba service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033395 Aug 26 11:09:39.174403 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 295/608] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:09:39.230478 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-d12e05cd-26d8-4d2f-90ed-647fecf139fc tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:39.231077 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-d12e05cd-26d8-4d2f-90ed-647fecf139fc tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:39.237351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d12e05cd-26d8-4d2f-90ed-647fecf139fc tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:39.237840 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d12e05cd-26d8-4d2f-90ed-647fecf139fc tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:39.238364 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d12e05cd-26d8-4d2f-90ed-647fecf139fc tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:39.239073 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d12e05cd-26d8-4d2f-90ed-647fecf139fc tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:39.239664 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d12e05cd-26d8-4d2f-90ed-647fecf139fc tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:39.239948 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d12e05cd-26d8-4d2f-90ed-647fecf139fc tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:39.267003 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-d12e05cd-26d8-4d2f-90ed-647fecf139fc tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Going to try to terminate instance {{(pid=120605) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:09:39.350743 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-d12e05cd-26d8-4d2f-90ed-647fecf139fc tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "DELETE /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 204 len: 0 microversion: 2.1 time: 0.123752 Aug 26 11:09:39.351412 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 314/609] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:09:39 2022] DELETE /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:09:39.363507 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0d56dbe6-2053-4ac5-9cf2-7d93747e6f1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:39.364449 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0d56dbe6-2053-4ac5-9cf2-7d93747e6f1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:39.371614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d56dbe6-2053-4ac5-9cf2-7d93747e6f1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:39.372213 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d56dbe6-2053-4ac5-9cf2-7d93747e6f1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:39.372658 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d56dbe6-2053-4ac5-9cf2-7d93747e6f1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:39.373368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d56dbe6-2053-4ac5-9cf2-7d93747e6f1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:39.373831 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d56dbe6-2053-4ac5-9cf2-7d93747e6f1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:39.374437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d56dbe6-2053-4ac5-9cf2-7d93747e6f1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:39.385231 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-15cae503-7fb2-43df-8988-74d173d0bc9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:39.385820 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-15cae503-7fb2-43df-8988-74d173d0bc9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:39.392429 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-15cae503-7fb2-43df-8988-74d173d0bc9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:39.392909 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-15cae503-7fb2-43df-8988-74d173d0bc9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:39.393350 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-15cae503-7fb2-43df-8988-74d173d0bc9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:39.394081 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-15cae503-7fb2-43df-8988-74d173d0bc9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:39.394541 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-15cae503-7fb2-43df-8988-74d173d0bc9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:39.394964 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-15cae503-7fb2-43df-8988-74d173d0bc9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:39.421273 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-15cae503-7fb2-43df-8988-74d173d0bc9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Going to try to terminate instance {{(pid=120605) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:09:39.514300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-15cae503-7fb2-43df-8988-74d173d0bc9d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 204 len: 0 microversion: 2.1 time: 0.132891 Aug 26 11:09:39.514902 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 315/610] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:09:39 2022] DELETE /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 11:09:39.516248 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0d56dbe6-2053-4ac5-9cf2-7d93747e6f1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:39.524150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-ffcbfa3a-8058-4be7-8ca0-748abbbcb49b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:39.524853 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-ffcbfa3a-8058-4be7-8ca0-748abbbcb49b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:39.524962 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0d56dbe6-2053-4ac5-9cf2-7d93747e6f1f tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1514 microversion: 2.1 time: 0.168274 Aug 26 11:09:39.525425 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 296/611] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:39 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:39.531517 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ffcbfa3a-8058-4be7-8ca0-748abbbcb49b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:39.532170 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ffcbfa3a-8058-4be7-8ca0-748abbbcb49b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:39.532613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ffcbfa3a-8058-4be7-8ca0-748abbbcb49b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:39.533329 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ffcbfa3a-8058-4be7-8ca0-748abbbcb49b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:39.533783 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ffcbfa3a-8058-4be7-8ca0-748abbbcb49b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:39.534256 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ffcbfa3a-8058-4be7-8ca0-748abbbcb49b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:39.672156 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-ffcbfa3a-8058-4be7-8ca0-748abbbcb49b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:39.680562 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-ffcbfa3a-8058-4be7-8ca0-748abbbcb49b tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1508 microversion: 2.1 time: 0.160647 Aug 26 11:09:39.681078 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 316/612] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:39 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:39.977432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-930c4d9e-b69b-4667-9a85-d48aea476e4c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:39.978051 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-930c4d9e-b69b-4667-9a85-d48aea476e4c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:39.984523 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-930c4d9e-b69b-4667-9a85-d48aea476e4c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:39.985573 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-930c4d9e-b69b-4667-9a85-d48aea476e4c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:39.986034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-930c4d9e-b69b-4667-9a85-d48aea476e4c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:39.986723 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-930c4d9e-b69b-4667-9a85-d48aea476e4c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:39.987167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-930c4d9e-b69b-4667-9a85-d48aea476e4c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:39.987584 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-930c4d9e-b69b-4667-9a85-d48aea476e4c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:40.019124 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-930c4d9e-b69b-4667-9a85-d48aea476e4c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:40.019600 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-930c4d9e-b69b-4667-9a85-d48aea476e4c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:40.020028 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-930c4d9e-b69b-4667-9a85-d48aea476e4c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:40.020465 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-930c4d9e-b69b-4667-9a85-d48aea476e4c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lazy-loading 'fault' on Instance uuid 136f48c9-a521-4bc3-b6cc-98da91d02c49 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:09:40.060995 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-930c4d9e-b69b-4667-9a85-d48aea476e4c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:40.070068 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-930c4d9e-b69b-4667-9a85-d48aea476e4c tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1346 microversion: 2.1 time: 0.096418 Aug 26 11:09:40.070640 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 297/613] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:39 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:40.546941 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-2b014a3f-ca84-47d5-b582-78372d413423 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:40.547809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-2b014a3f-ca84-47d5-b582-78372d413423 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:40.553967 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2b014a3f-ca84-47d5-b582-78372d413423 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:40.554476 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2b014a3f-ca84-47d5-b582-78372d413423 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:40.554906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2b014a3f-ca84-47d5-b582-78372d413423 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:40.555593 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2b014a3f-ca84-47d5-b582-78372d413423 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:40.556043 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2b014a3f-ca84-47d5-b582-78372d413423 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:40.556710 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2b014a3f-ca84-47d5-b582-78372d413423 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:40.698062 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-2b014a3f-ca84-47d5-b582-78372d413423 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:40.701302 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4a5b99c9-538c-4ca3-8947-0b7e03d87d11 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:40.701922 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4a5b99c9-538c-4ca3-8947-0b7e03d87d11 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:40.706274 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-2b014a3f-ca84-47d5-b582-78372d413423 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1514 microversion: 2.1 time: 0.163601 Aug 26 11:09:40.706881 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 317/614] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:40 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:40.708701 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4a5b99c9-538c-4ca3-8947-0b7e03d87d11 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:40.709193 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4a5b99c9-538c-4ca3-8947-0b7e03d87d11 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:40.709635 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4a5b99c9-538c-4ca3-8947-0b7e03d87d11 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:40.710369 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4a5b99c9-538c-4ca3-8947-0b7e03d87d11 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:40.710827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4a5b99c9-538c-4ca3-8947-0b7e03d87d11 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:40.711256 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4a5b99c9-538c-4ca3-8947-0b7e03d87d11 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:40.841198 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4a5b99c9-538c-4ca3-8947-0b7e03d87d11 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:40.849149 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4a5b99c9-538c-4ca3-8947-0b7e03d87d11 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1508 microversion: 2.1 time: 0.151600 Aug 26 11:09:40.849719 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 298/615] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:40 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:41.099531 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f6d0781c-360a-4de6-867e-752efb9e925d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:41.100597 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f6d0781c-360a-4de6-867e-752efb9e925d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:41.113014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f6d0781c-360a-4de6-867e-752efb9e925d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:41.113877 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f6d0781c-360a-4de6-867e-752efb9e925d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:41.114678 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f6d0781c-360a-4de6-867e-752efb9e925d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:41.115831 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f6d0781c-360a-4de6-867e-752efb9e925d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:41.116661 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f6d0781c-360a-4de6-867e-752efb9e925d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:41.117406 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f6d0781c-360a-4de6-867e-752efb9e925d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:41.160358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f6d0781c-360a-4de6-867e-752efb9e925d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:41.160841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f6d0781c-360a-4de6-867e-752efb9e925d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:41.161279 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f6d0781c-360a-4de6-867e-752efb9e925d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:41.161738 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-f6d0781c-360a-4de6-867e-752efb9e925d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lazy-loading 'fault' on Instance uuid 136f48c9-a521-4bc3-b6cc-98da91d02c49 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:09:41.211336 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f6d0781c-360a-4de6-867e-752efb9e925d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:41.220104 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f6d0781c-360a-4de6-867e-752efb9e925d tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1346 microversion: 2.1 time: 0.129579 Aug 26 11:09:41.220672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 318/616] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:41 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1346 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:41.728281 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2e69d214-a128-4c4a-b6dc-f3f7d38ed69b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:41.728891 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2e69d214-a128-4c4a-b6dc-f3f7d38ed69b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:41.736411 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2e69d214-a128-4c4a-b6dc-f3f7d38ed69b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:41.736895 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2e69d214-a128-4c4a-b6dc-f3f7d38ed69b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:41.737330 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2e69d214-a128-4c4a-b6dc-f3f7d38ed69b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:41.738054 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2e69d214-a128-4c4a-b6dc-f3f7d38ed69b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:41.738499 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2e69d214-a128-4c4a-b6dc-f3f7d38ed69b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:41.739011 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2e69d214-a128-4c4a-b6dc-f3f7d38ed69b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:41.870832 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-9a26a78f-4aab-49e4-a3f2-c342f677a232 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:41.872251 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9a26a78f-4aab-49e4-a3f2-c342f677a232 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:41.880680 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9a26a78f-4aab-49e4-a3f2-c342f677a232 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:41.881171 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9a26a78f-4aab-49e4-a3f2-c342f677a232 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:41.881671 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9a26a78f-4aab-49e4-a3f2-c342f677a232 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:41.882450 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9a26a78f-4aab-49e4-a3f2-c342f677a232 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:41.882904 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9a26a78f-4aab-49e4-a3f2-c342f677a232 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:41.883322 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9a26a78f-4aab-49e4-a3f2-c342f677a232 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:41.886077 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2e69d214-a128-4c4a-b6dc-f3f7d38ed69b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:41.894397 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2e69d214-a128-4c4a-b6dc-f3f7d38ed69b tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1514 microversion: 2.1 time: 0.169945 Aug 26 11:09:41.895087 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 299/617] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:41 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:42.022651 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9a26a78f-4aab-49e4-a3f2-c342f677a232 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:42.040243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-9a26a78f-4aab-49e4-a3f2-c342f677a232 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1508 microversion: 2.1 time: 0.173553 Aug 26 11:09:42.040873 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 319/618] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:41 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:42.244154 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7cd39daf-b040-4a2d-a8b0-e2c429455972 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:42.244767 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7cd39daf-b040-4a2d-a8b0-e2c429455972 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:42.251195 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7cd39daf-b040-4a2d-a8b0-e2c429455972 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:42.251680 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7cd39daf-b040-4a2d-a8b0-e2c429455972 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:42.252115 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7cd39daf-b040-4a2d-a8b0-e2c429455972 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:42.252816 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7cd39daf-b040-4a2d-a8b0-e2c429455972 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:42.253359 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7cd39daf-b040-4a2d-a8b0-e2c429455972 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:42.253687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7cd39daf-b040-4a2d-a8b0-e2c429455972 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:42.286299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7cd39daf-b040-4a2d-a8b0-e2c429455972 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:42.286801 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7cd39daf-b040-4a2d-a8b0-e2c429455972 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:42.287236 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7cd39daf-b040-4a2d-a8b0-e2c429455972 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:42.287685 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-7cd39daf-b040-4a2d-a8b0-e2c429455972 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lazy-loading 'fault' on Instance uuid 136f48c9-a521-4bc3-b6cc-98da91d02c49 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:09:42.337886 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7cd39daf-b040-4a2d-a8b0-e2c429455972 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:42.346634 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7cd39daf-b040-4a2d-a8b0-e2c429455972 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1346 microversion: 2.1 time: 0.106457 Aug 26 11:09:42.347207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 300/619] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:42 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:42.918214 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0dac0103-f07f-4415-aa0f-59d143bc114d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:42.919435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0dac0103-f07f-4415-aa0f-59d143bc114d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:42.927874 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0dac0103-f07f-4415-aa0f-59d143bc114d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:42.928375 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0dac0103-f07f-4415-aa0f-59d143bc114d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:42.928819 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0dac0103-f07f-4415-aa0f-59d143bc114d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:42.929569 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0dac0103-f07f-4415-aa0f-59d143bc114d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:42.930053 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0dac0103-f07f-4415-aa0f-59d143bc114d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:42.930490 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0dac0103-f07f-4415-aa0f-59d143bc114d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:43.060847 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e47d2d48-a905-4b66-8510-8d9ffefab63e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:43.061474 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e47d2d48-a905-4b66-8510-8d9ffefab63e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:43.068408 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e47d2d48-a905-4b66-8510-8d9ffefab63e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:43.068994 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e47d2d48-a905-4b66-8510-8d9ffefab63e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:43.069255 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0dac0103-f07f-4415-aa0f-59d143bc114d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:43.069585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e47d2d48-a905-4b66-8510-8d9ffefab63e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:43.070438 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e47d2d48-a905-4b66-8510-8d9ffefab63e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:43.070952 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e47d2d48-a905-4b66-8510-8d9ffefab63e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:43.071456 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e47d2d48-a905-4b66-8510-8d9ffefab63e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:43.078470 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0dac0103-f07f-4415-aa0f-59d143bc114d tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1514 microversion: 2.1 time: 0.163976 Aug 26 11:09:43.079310 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 320/620] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:42 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:43.212174 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e47d2d48-a905-4b66-8510-8d9ffefab63e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:43.220236 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e47d2d48-a905-4b66-8510-8d9ffefab63e tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1508 microversion: 2.1 time: 0.163210 Aug 26 11:09:43.220810 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 301/621] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:43 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:09:43.367818 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-bdd9cdee-80aa-4043-91cf-2d2387f35f18 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:43.368447 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-bdd9cdee-80aa-4043-91cf-2d2387f35f18 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:43.375322 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bdd9cdee-80aa-4043-91cf-2d2387f35f18 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:43.375812 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bdd9cdee-80aa-4043-91cf-2d2387f35f18 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:43.376253 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bdd9cdee-80aa-4043-91cf-2d2387f35f18 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:43.376957 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bdd9cdee-80aa-4043-91cf-2d2387f35f18 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:43.377414 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bdd9cdee-80aa-4043-91cf-2d2387f35f18 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:43.377946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bdd9cdee-80aa-4043-91cf-2d2387f35f18 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:43.416578 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bdd9cdee-80aa-4043-91cf-2d2387f35f18 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:43.417309 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bdd9cdee-80aa-4043-91cf-2d2387f35f18 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:43.417746 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bdd9cdee-80aa-4043-91cf-2d2387f35f18 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:43.418477 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-bdd9cdee-80aa-4043-91cf-2d2387f35f18 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lazy-loading 'fault' on Instance uuid 136f48c9-a521-4bc3-b6cc-98da91d02c49 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:09:43.461849 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-bdd9cdee-80aa-4043-91cf-2d2387f35f18 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8fb67568674d0b91424e2a16407539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9483fc8d1764471b99c49e4ee46c0b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:43.469814 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-bdd9cdee-80aa-4043-91cf-2d2387f35f18 tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 200 len: 1346 microversion: 2.1 time: 0.105947 Aug 26 11:09:43.470409 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 321/622] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:43 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 1346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:44.100645 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9830920c-e1a4-4bb6-af23-092304283aa1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:44.101256 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9830920c-e1a4-4bb6-af23-092304283aa1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:44.103885 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:44.109131 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9830920c-e1a4-4bb6-af23-092304283aa1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:44.109727 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9830920c-e1a4-4bb6-af23-092304283aa1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:44.110255 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9830920c-e1a4-4bb6-af23-092304283aa1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:44.110961 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9830920c-e1a4-4bb6-af23-092304283aa1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:44.111418 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9830920c-e1a4-4bb6-af23-092304283aa1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:44.111839 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9830920c-e1a4-4bb6-af23-092304283aa1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:44.242535 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-683cc8c1-3865-4ece-bb93-cd4e9fceca61 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:44.243442 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-683cc8c1-3865-4ece-bb93-cd4e9fceca61 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:44.250555 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9830920c-e1a4-4bb6-af23-092304283aa1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:44.251476 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-683cc8c1-3865-4ece-bb93-cd4e9fceca61 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:44.251971 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-683cc8c1-3865-4ece-bb93-cd4e9fceca61 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:44.252406 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-683cc8c1-3865-4ece-bb93-cd4e9fceca61 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:44.253373 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-683cc8c1-3865-4ece-bb93-cd4e9fceca61 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:44.253831 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-683cc8c1-3865-4ece-bb93-cd4e9fceca61 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:44.254280 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-683cc8c1-3865-4ece-bb93-cd4e9fceca61 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:44.259502 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9830920c-e1a4-4bb6-af23-092304283aa1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1514 microversion: 2.1 time: 0.162604 Aug 26 11:09:44.274255 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 302/623] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:44 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:44.403154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-683cc8c1-3865-4ece-bb93-cd4e9fceca61 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:44.412645 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-683cc8c1-3865-4ece-bb93-cd4e9fceca61 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1508 microversion: 2.1 time: 0.174171 Aug 26 11:09:44.413434 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 322/624] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:44 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:44.491284 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d5a23d3c-dea0-4a58-9e30-3ff5a30d5f2b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:44.491896 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d5a23d3c-dea0-4a58-9e30-3ff5a30d5f2b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] [instance: 136f48c9-a521-4bc3-b6cc-98da91d02c49] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:44.498155 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5a23d3c-dea0-4a58-9e30-3ff5a30d5f2b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:44.498643 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5a23d3c-dea0-4a58-9e30-3ff5a30d5f2b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:44.499075 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5a23d3c-dea0-4a58-9e30-3ff5a30d5f2b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:44.500342 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5a23d3c-dea0-4a58-9e30-3ff5a30d5f2b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:44.501022 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5a23d3c-dea0-4a58-9e30-3ff5a30d5f2b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:44.501388 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5a23d3c-dea0-4a58-9e30-3ff5a30d5f2b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:44.517860 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-d5a23d3c-dea0-4a58-9e30-3ff5a30d5f2b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] HTTP exception thrown: Instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 could not be found. Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d5a23d3c-dea0-4a58-9e30-3ff5a30d5f2b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Request method failure captured: Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 HTTP/1.1 Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKk0iDbLPmDpSYj37c5d3HI3sZcyqBdOjj7_9DoW2QGe6Jd7BZ1Z5UdyS1lxfH1jDzpp-hBco38EmpN0vzIBPeBTsYRNVINNlUo8gr4SJa75Z_PKYkdx5lcjkKZmaGDF2DPGwUVYTxdS5oxdjqscwmjabqe-xHJ3-Akheo6R7M-gotA Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: 9483fc8d1764471b99c49e4ee46c0b12 Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-TestMinimumBasicScenario-1692263360 Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:09:44.519715 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:09:44.521108 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9483fc8d1764471b99c49e4ee46c0b12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9483fc8d1764471b99c49e4ee46c0b12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9483fc8d1764471b99c49e4ee46c0b12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9483fc8d1764471b99c49e4ee46c0b12"}]}] Aug 26 11:09:44.521108 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-TestMinimumBasicScenario-1692263360 Aug 26 11:09:44.521108 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 9483fc8d1764471b99c49e4ee46c0b12 Aug 26 11:09:44.521108 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1692263360 Aug 26 11:09:44.521108 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-TestMinimumBasicScenario-1692263360-project Aug 26 11:09:44.521108 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:09:44.521108 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:09:44.521108 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: be8fb67568674d0b91424e2a16407539 Aug 26 11:09:44.521108 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-TestMinimumBasicScenario-1692263360-project Aug 26 11:09:44.521108 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:09:44.521108 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 could not be found. Aug 26 11:09:44.521108 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': '136f48c9-a521-4bc3-b6cc-98da91d02c49'} Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 could not be found. Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:09:44.521997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 could not be found. Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 could not be found. Aug 26 11:09:44.523269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:44.524403 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d5a23d3c-dea0-4a58-9e30-3ff5a30d5f2b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Returning 404 to user: Instance 136f48c9-a521-4bc3-b6cc-98da91d02c49 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:09:44.524403 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d5a23d3c-dea0-4a58-9e30-3ff5a30d5f2b tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49" status: 404 len: 111 microversion: 2.1 time: 0.033791 Aug 26 11:09:44.530217 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1c6b9014-5d97-4625-bc38-9baa17d7fd7a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] Calling method '.version_select at 0x7f1a68829790>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:44.534144 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 303/625] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:44 2022] GET /compute/v2.1/servers/136f48c9-a521-4bc3-b6cc-98da91d02c49 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:09:44.554157 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1c6b9014-5d97-4625-bc38-9baa17d7fd7a tempest-TestMinimumBasicScenario-1692263360 tempest-TestMinimumBasicScenario-1692263360-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-54957731" status: 202 len: 0 microversion: 2.1 time: 0.027656 Aug 26 11:09:44.554742 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 323/626] 10.222.0.40 () {58 vars in 1266 bytes} [Fri Aug 26 11:09:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-54957731 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:09:44.707861 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-e6939e9d-f6ef-43a4-9627-b5151cf0ba85 req-623fae34-9008-4330-bbbd-57842712736a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca6ba27-f52a-4bcb-9e67-d09645be0b19", "name": "network-vif-deleted", "tag": "2088f2dc-209d-4e12-8ff3-5642dd1ed8b2"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:44.726914 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e6939e9d-f6ef-43a4-9627-b5151cf0ba85 req-623fae34-9008-4330-bbbd-57842712736a service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:44.727402 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e6939e9d-f6ef-43a4-9627-b5151cf0ba85 req-623fae34-9008-4330-bbbd-57842712736a service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:44.727838 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e6939e9d-f6ef-43a4-9627-b5151cf0ba85 req-623fae34-9008-4330-bbbd-57842712736a service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:44.756707 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-e6939e9d-f6ef-43a4-9627-b5151cf0ba85 req-623fae34-9008-4330-bbbd-57842712736a service nova] Creating event network-vif-deleted:2088f2dc-209d-4e12-8ff3-5642dd1ed8b2 for instance aca6ba27-f52a-4bcb-9e67-d09645be0b19 on hv-cinder-85236 Aug 26 11:09:44.762967 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-e6939e9d-f6ef-43a4-9627-b5151cf0ba85 req-623fae34-9008-4330-bbbd-57842712736a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059677 Aug 26 11:09:44.764300 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 304/627] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:09:45.284351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-170bd2ed-4d39-49e9-9a1b-2d7a688fcdb1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:45.285021 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-170bd2ed-4d39-49e9-9a1b-2d7a688fcdb1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:45.301514 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-170bd2ed-4d39-49e9-9a1b-2d7a688fcdb1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:45.301514 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-170bd2ed-4d39-49e9-9a1b-2d7a688fcdb1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:45.301514 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-170bd2ed-4d39-49e9-9a1b-2d7a688fcdb1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:45.301514 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-170bd2ed-4d39-49e9-9a1b-2d7a688fcdb1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:45.301882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-170bd2ed-4d39-49e9-9a1b-2d7a688fcdb1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:45.301882 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-170bd2ed-4d39-49e9-9a1b-2d7a688fcdb1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:45.336580 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-170bd2ed-4d39-49e9-9a1b-2d7a688fcdb1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:45.337158 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-170bd2ed-4d39-49e9-9a1b-2d7a688fcdb1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:45.337597 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-170bd2ed-4d39-49e9-9a1b-2d7a688fcdb1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:45.338076 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-170bd2ed-4d39-49e9-9a1b-2d7a688fcdb1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lazy-loading 'fault' on Instance uuid aca6ba27-f52a-4bcb-9e67-d09645be0b19 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:09:45.340183 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:09:45.391476 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-170bd2ed-4d39-49e9-9a1b-2d7a688fcdb1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3aaf776da3a4bb0853946c195112f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de754769f766487e859de1729e9d7a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:45.400667 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-170bd2ed-4d39-49e9-9a1b-2d7a688fcdb1 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 200 len: 1309 microversion: 2.1 time: 0.121057 Aug 26 11:09:45.401892 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 324/628] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:45 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 1309 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:45.436543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0d91368f-53ce-46d4-a233-7f33108224a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:45.437500 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0d91368f-53ce-46d4-a233-7f33108224a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:45.443663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d91368f-53ce-46d4-a233-7f33108224a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:45.444142 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d91368f-53ce-46d4-a233-7f33108224a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:45.444577 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d91368f-53ce-46d4-a233-7f33108224a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:45.445269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d91368f-53ce-46d4-a233-7f33108224a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:45.445709 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d91368f-53ce-46d4-a233-7f33108224a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:45.446159 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d91368f-53ce-46d4-a233-7f33108224a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:45.478159 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d91368f-53ce-46d4-a233-7f33108224a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:45.478671 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d91368f-53ce-46d4-a233-7f33108224a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:45.479073 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d91368f-53ce-46d4-a233-7f33108224a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:45.479514 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-0d91368f-53ce-46d4-a233-7f33108224a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lazy-loading 'fault' on Instance uuid b78ce714-fb3b-4478-9d40-7e298961441e {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:09:45.521550 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0d91368f-53ce-46d4-a233-7f33108224a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:45.529300 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0d91368f-53ce-46d4-a233-7f33108224a4 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 200 len: 1312 microversion: 2.1 time: 0.097563 Aug 26 11:09:45.529884 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 305/629] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:45 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:46.424699 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-47c89efb-a121-45cb-befa-084715edeb20 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:46.426096 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-47c89efb-a121-45cb-befa-084715edeb20 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] [instance: aca6ba27-f52a-4bcb-9e67-d09645be0b19] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:46.433241 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-47c89efb-a121-45cb-befa-084715edeb20 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:46.433737 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-47c89efb-a121-45cb-befa-084715edeb20 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:46.434359 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-47c89efb-a121-45cb-befa-084715edeb20 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:46.435083 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-47c89efb-a121-45cb-befa-084715edeb20 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:46.435531 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-47c89efb-a121-45cb-befa-084715edeb20 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:46.436074 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-47c89efb-a121-45cb-befa-084715edeb20 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:46.453153 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-47c89efb-a121-45cb-befa-084715edeb20 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] HTTP exception thrown: Instance aca6ba27-f52a-4bcb-9e67-d09645be0b19 could not be found. Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-47c89efb-a121-45cb-befa-084715edeb20 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Request method failure captured: Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 HTTP/1.1 Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKlxj7UC9JiA9F40iIbwE4_82Z5j01zJYGBHYiJW7r1QrRrgPYcrU_ToTZ0sXbZ4YNmuEzaQ8nrCGFnw6seCacmjkEL-Zjx5H_h41LvnMmPP_WM8Z5vbwQWPFxUY63R2o6jaR31dPVsIKDfRIyOXLs6quqBlFJ2r6E8uAVGAs91Y1f0 Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: de754769f766487e859de1729e9d7a77 Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-VolumesSnapshotTestJSON-898562999 Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:09:46.455122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:09:46.456721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_de754769f766487e859de1729e9d7a77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/de754769f766487e859de1729e9d7a77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/de754769f766487e859de1729e9d7a77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/de754769f766487e859de1729e9d7a77"}]}] Aug 26 11:09:46.456721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-VolumesSnapshotTestJSON-898562999 Aug 26 11:09:46.456721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: de754769f766487e859de1729e9d7a77 Aug 26 11:09:46.456721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-898562999 Aug 26 11:09:46.456721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-VolumesSnapshotTestJSON-898562999-project Aug 26 11:09:46.456721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:09:46.456721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:09:46.456721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: c3aaf776da3a4bb0853946c195112f40 Aug 26 11:09:46.456721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-VolumesSnapshotTestJSON-898562999-project Aug 26 11:09:46.456721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:09:46.456721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance aca6ba27-f52a-4bcb-9e67-d09645be0b19 could not be found. Aug 26 11:09:46.456721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': 'aca6ba27-f52a-4bcb-9e67-d09645be0b19'} Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aca6ba27-f52a-4bcb-9e67-d09645be0b19 could not be found. Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:09:46.457628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aca6ba27-f52a-4bcb-9e67-d09645be0b19 could not be found. Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aca6ba27-f52a-4bcb-9e67-d09645be0b19 could not be found. Aug 26 11:09:46.458933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:09:46.460000 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-47c89efb-a121-45cb-befa-084715edeb20 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] Returning 404 to user: Instance aca6ba27-f52a-4bcb-9e67-d09645be0b19 could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:09:46.460000 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-47c89efb-a121-45cb-befa-084715edeb20 tempest-VolumesSnapshotTestJSON-898562999 tempest-VolumesSnapshotTestJSON-898562999-project] 10.222.0.40 "GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19" status: 404 len: 111 microversion: 2.1 time: 0.037310 Aug 26 11:09:46.460000 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 325/630] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:46 2022] GET /compute/v2.1/servers/aca6ba27-f52a-4bcb-9e67-d09645be0b19 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:09:46.560656 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1c9d9d85-652e-40a5-9036-766b75c8c020 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:46.563639 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1c9d9d85-652e-40a5-9036-766b75c8c020 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: b78ce714-fb3b-4478-9d40-7e298961441e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:46.572562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1c9d9d85-652e-40a5-9036-766b75c8c020 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:46.573450 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1c9d9d85-652e-40a5-9036-766b75c8c020 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:46.574231 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1c9d9d85-652e-40a5-9036-766b75c8c020 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:46.575387 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1c9d9d85-652e-40a5-9036-766b75c8c020 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:46.576593 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1c9d9d85-652e-40a5-9036-766b75c8c020 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:46.577246 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1c9d9d85-652e-40a5-9036-766b75c8c020 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:46.598342 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-1c9d9d85-652e-40a5-9036-766b75c8c020 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] HTTP exception thrown: Instance b78ce714-fb3b-4478-9d40-7e298961441e could not be found. Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1c9d9d85-652e-40a5-9036-766b75c8c020 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Request method failure captured: Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e HTTP/1.1 Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKjKoFWt_mGTxQc01qKCjXUDq7iYUfd7QeRZ0zpT5eoQIJBk_9LMauXMlsoKUf_7HcU9hxiDc2CZHgZUc6PoeUKDo4e4ygyUFdoUFueMawN06Zy51crBpM09ad2MKRCu2-vRhJQ6qXBCPYLTkAj0OO2mr6xCjOndICFG1gqY_Xj_h7k Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: 7db3b983562e49cfbb77c9e64b6e6cb9 Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-818754082 Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:09:46.602451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:09:46.603781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7db3b983562e49cfbb77c9e64b6e6cb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7db3b983562e49cfbb77c9e64b6e6cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7db3b983562e49cfbb77c9e64b6e6cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7db3b983562e49cfbb77c9e64b6e6cb9"}]}] Aug 26 11:09:46.603781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-ServerRescueNegativeTestJSON-818754082 Aug 26 11:09:46.603781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 7db3b983562e49cfbb77c9e64b6e6cb9 Aug 26 11:09:46.603781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-818754082 Aug 26 11:09:46.603781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-ServerRescueNegativeTestJSON-818754082-project Aug 26 11:09:46.603781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:09:46.603781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:09:46.603781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: d6dbbabdd88c4c088bc91e6c43531318 Aug 26 11:09:46.603781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-ServerRescueNegativeTestJSON-818754082-project Aug 26 11:09:46.603781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:09:46.603781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance b78ce714-fb3b-4478-9d40-7e298961441e could not be found. Aug 26 11:09:46.603781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'b78ce714-fb3b-4478-9d40-7e298961441e'} Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b78ce714-fb3b-4478-9d40-7e298961441e could not be found. Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:09:46.604503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b78ce714-fb3b-4478-9d40-7e298961441e could not be found. Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b78ce714-fb3b-4478-9d40-7e298961441e could not be found. Aug 26 11:09:46.605686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:09:46.610204 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1c9d9d85-652e-40a5-9036-766b75c8c020 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Returning 404 to user: Instance b78ce714-fb3b-4478-9d40-7e298961441e could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:09:46.611701 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1c9d9d85-652e-40a5-9036-766b75c8c020 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e" status: 404 len: 111 microversion: 2.1 time: 0.061824 Aug 26 11:09:46.614174 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 306/631] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:46 2022] GET /compute/v2.1/servers/b78ce714-fb3b-4478-9d40-7e298961441e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:09:46.626026 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-e707c612-f86d-4a72-b3b0-d1b6dd8a60a8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:46.627767 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e707c612-f86d-4a72-b3b0-d1b6dd8a60a8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:46.637603 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e707c612-f86d-4a72-b3b0-d1b6dd8a60a8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:46.638753 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e707c612-f86d-4a72-b3b0-d1b6dd8a60a8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:46.639679 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e707c612-f86d-4a72-b3b0-d1b6dd8a60a8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:46.641103 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e707c612-f86d-4a72-b3b0-d1b6dd8a60a8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:46.642117 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e707c612-f86d-4a72-b3b0-d1b6dd8a60a8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:46.643174 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e707c612-f86d-4a72-b3b0-d1b6dd8a60a8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:46.695508 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e707c612-f86d-4a72-b3b0-d1b6dd8a60a8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Going to try to terminate instance {{(pid=120605) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:09:46.790825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-e9f239c1-489c-4212-9e09-542db7670ab0 req-6b5708be-7c80-4ca9-811f-fd06c713dc23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78ce714-fb3b-4478-9d40-7e298961441e", "name": "network-vif-deleted", "tag": "57c9d59f-1551-4d0a-834b-3fb18f12f22f"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:46.808444 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e9f239c1-489c-4212-9e09-542db7670ab0 req-6b5708be-7c80-4ca9-811f-fd06c713dc23 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:46.809185 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e9f239c1-489c-4212-9e09-542db7670ab0 req-6b5708be-7c80-4ca9-811f-fd06c713dc23 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:46.809902 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e9f239c1-489c-4212-9e09-542db7670ab0 req-6b5708be-7c80-4ca9-811f-fd06c713dc23 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:46.826960 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-e9f239c1-489c-4212-9e09-542db7670ab0 req-6b5708be-7c80-4ca9-811f-fd06c713dc23 service nova] Creating event network-vif-deleted:57c9d59f-1551-4d0a-834b-3fb18f12f22f for instance b78ce714-fb3b-4478-9d40-7e298961441e on hv-cinder-85236 Aug 26 11:09:46.833415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-e9f239c1-489c-4212-9e09-542db7670ab0 req-6b5708be-7c80-4ca9-811f-fd06c713dc23 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046113 Aug 26 11:09:46.834304 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 307/632] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:09:46.909239 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-e707c612-f86d-4a72-b3b0-d1b6dd8a60a8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "DELETE /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 204 len: 0 microversion: 2.1 time: 0.290257 Aug 26 11:09:46.910116 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 326/633] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:09:46 2022] DELETE /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:09:46.928162 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a61e3364-9cd1-4b4f-bd09-5764babc4865 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:46.928879 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a61e3364-9cd1-4b4f-bd09-5764babc4865 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:46.942658 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a61e3364-9cd1-4b4f-bd09-5764babc4865 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:46.943463 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a61e3364-9cd1-4b4f-bd09-5764babc4865 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:46.944062 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a61e3364-9cd1-4b4f-bd09-5764babc4865 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:46.948558 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a61e3364-9cd1-4b4f-bd09-5764babc4865 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:46.949403 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a61e3364-9cd1-4b4f-bd09-5764babc4865 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:46.950407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a61e3364-9cd1-4b4f-bd09-5764babc4865 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:47.099042 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a61e3364-9cd1-4b4f-bd09-5764babc4865 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:47.108368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a61e3364-9cd1-4b4f-bd09-5764babc4865 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.193741 Aug 26 11:09:47.113947 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 308/634] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:46 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:48.132920 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b6260252-6c8f-4e47-93e6-0c5ab8b8f39f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:48.134727 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b6260252-6c8f-4e47-93e6-0c5ab8b8f39f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:48.143998 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6260252-6c8f-4e47-93e6-0c5ab8b8f39f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:48.144930 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6260252-6c8f-4e47-93e6-0c5ab8b8f39f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:48.145587 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6260252-6c8f-4e47-93e6-0c5ab8b8f39f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:48.146565 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6260252-6c8f-4e47-93e6-0c5ab8b8f39f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:48.147279 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6260252-6c8f-4e47-93e6-0c5ab8b8f39f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:48.148034 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6260252-6c8f-4e47-93e6-0c5ab8b8f39f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:48.363879 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b6260252-6c8f-4e47-93e6-0c5ab8b8f39f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:48.372610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b6260252-6c8f-4e47-93e6-0c5ab8b8f39f tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.244609 Aug 26 11:09:48.373204 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 327/635] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:48 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:49.395292 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ac47854e-d287-473c-bcdb-f28fbb7946ab tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:49.396584 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ac47854e-d287-473c-bcdb-f28fbb7946ab tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:49.404591 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac47854e-d287-473c-bcdb-f28fbb7946ab tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:49.405074 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac47854e-d287-473c-bcdb-f28fbb7946ab tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:49.405647 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac47854e-d287-473c-bcdb-f28fbb7946ab tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:49.406560 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac47854e-d287-473c-bcdb-f28fbb7946ab tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:49.406885 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac47854e-d287-473c-bcdb-f28fbb7946ab tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:49.407312 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac47854e-d287-473c-bcdb-f28fbb7946ab tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:49.622654 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ac47854e-d287-473c-bcdb-f28fbb7946ab tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:49.631207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ac47854e-d287-473c-bcdb-f28fbb7946ab tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.239721 Aug 26 11:09:49.631796 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 309/636] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:49 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:50.656953 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4f305dc4-f719-411a-a993-f68a5ce91fb1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:50.657577 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4f305dc4-f719-411a-a993-f68a5ce91fb1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:50.664942 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f305dc4-f719-411a-a993-f68a5ce91fb1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:50.665435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f305dc4-f719-411a-a993-f68a5ce91fb1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:50.666047 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f305dc4-f719-411a-a993-f68a5ce91fb1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:50.666770 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f305dc4-f719-411a-a993-f68a5ce91fb1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:50.667224 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f305dc4-f719-411a-a993-f68a5ce91fb1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:50.667653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f305dc4-f719-411a-a993-f68a5ce91fb1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:50.813090 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4f305dc4-f719-411a-a993-f68a5ce91fb1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:50.821615 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4f305dc4-f719-411a-a993-f68a5ce91fb1 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.170023 Aug 26 11:09:50.836155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 328/637] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:50 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:51.843025 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-915a3560-0844-4f32-a3bc-57baae602b1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:51.844744 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-915a3560-0844-4f32-a3bc-57baae602b1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:51.851646 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-915a3560-0844-4f32-a3bc-57baae602b1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:51.852198 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-915a3560-0844-4f32-a3bc-57baae602b1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:51.852701 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-915a3560-0844-4f32-a3bc-57baae602b1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:51.853411 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-915a3560-0844-4f32-a3bc-57baae602b1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:51.854006 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-915a3560-0844-4f32-a3bc-57baae602b1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:51.854582 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-915a3560-0844-4f32-a3bc-57baae602b1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:52.119239 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-915a3560-0844-4f32-a3bc-57baae602b1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:52.134852 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-915a3560-0844-4f32-a3bc-57baae602b1d tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1522 microversion: 2.1 time: 0.295567 Aug 26 11:09:52.148718 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 310/638] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:51 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:52.901564 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-7d5ec5fb-9296-4d89-969f-9845986b8d92 req-659a23ea-0466-4bd7-9086-d8aef132690e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc3934b-d598-47c2-9fcb-404b2fe5a478", "name": "network-vif-deleted", "tag": "e09f28fa-7224-41d2-b9f8-5ce2b96f6acc"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:09:52.931128 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-7d5ec5fb-9296-4d89-969f-9845986b8d92 req-659a23ea-0466-4bd7-9086-d8aef132690e service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:52.933340 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-7d5ec5fb-9296-4d89-969f-9845986b8d92 req-659a23ea-0466-4bd7-9086-d8aef132690e service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:52.934285 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-7d5ec5fb-9296-4d89-969f-9845986b8d92 req-659a23ea-0466-4bd7-9086-d8aef132690e service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:52.957620 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-7d5ec5fb-9296-4d89-969f-9845986b8d92 req-659a23ea-0466-4bd7-9086-d8aef132690e service nova] Creating event network-vif-deleted:e09f28fa-7224-41d2-b9f8-5ce2b96f6acc for instance dcc3934b-d598-47c2-9fcb-404b2fe5a478 on hv-cinder-85236 Aug 26 11:09:52.964443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-7d5ec5fb-9296-4d89-969f-9845986b8d92 req-659a23ea-0466-4bd7-9086-d8aef132690e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078007 Aug 26 11:09:52.966614 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 329/639] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:09:53.156178 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0c34147c-3131-4241-92a3-ed42cfbfc963 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:53.157921 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0c34147c-3131-4241-92a3-ed42cfbfc963 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:53.165064 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c34147c-3131-4241-92a3-ed42cfbfc963 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:53.165777 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c34147c-3131-4241-92a3-ed42cfbfc963 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:53.166413 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c34147c-3131-4241-92a3-ed42cfbfc963 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:53.167278 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c34147c-3131-4241-92a3-ed42cfbfc963 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:53.167728 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c34147c-3131-4241-92a3-ed42cfbfc963 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:53.168146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c34147c-3131-4241-92a3-ed42cfbfc963 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:53.216205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c34147c-3131-4241-92a3-ed42cfbfc963 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:53.216690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c34147c-3131-4241-92a3-ed42cfbfc963 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:53.217298 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c34147c-3131-4241-92a3-ed42cfbfc963 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:53.217903 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-0c34147c-3131-4241-92a3-ed42cfbfc963 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lazy-loading 'fault' on Instance uuid dcc3934b-d598-47c2-9fcb-404b2fe5a478 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:09:53.267383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0c34147c-3131-4241-92a3-ed42cfbfc963 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dbbabdd88c4c088bc91e6c43531318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db3b983562e49cfbb77c9e64b6e6cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:09:53.278851 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0c34147c-3131-4241-92a3-ed42cfbfc963 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 200 len: 1312 microversion: 2.1 time: 0.124362 Aug 26 11:09:53.280057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 311/640] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:53 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 1312 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:09:54.307590 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1df2c19a-534e-4402-89d2-1c3c74eba1d8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:09:54.308298 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-1df2c19a-534e-4402-89d2-1c3c74eba1d8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] [instance: dcc3934b-d598-47c2-9fcb-404b2fe5a478] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:09:54.310697 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 11:09:54.310875 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Fri Aug 26 11:09:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 (ip 10.222.0.40) !!! Aug 26 11:09:54.327693 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1df2c19a-534e-4402-89d2-1c3c74eba1d8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:54.328302 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1df2c19a-534e-4402-89d2-1c3c74eba1d8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:54.328754 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1df2c19a-534e-4402-89d2-1c3c74eba1d8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:54.329630 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1df2c19a-534e-4402-89d2-1c3c74eba1d8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:09:54.330205 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1df2c19a-534e-4402-89d2-1c3c74eba1d8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:09:54.330656 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1df2c19a-534e-4402-89d2-1c3c74eba1d8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:09:54.348425 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-1df2c19a-534e-4402-89d2-1c3c74eba1d8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] HTTP exception thrown: Instance dcc3934b-d598-47c2-9fcb-404b2fe5a478 could not be found. Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1df2c19a-534e-4402-89d2-1c3c74eba1d8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Request method failure captured: Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 HTTP/1.1 Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKjKoFWt_mGTxQc01qKCjXUDq7iYUfd7QeRZ0zpT5eoQIJBk_9LMauXMlsoKUf_7HcU9hxiDc2CZHgZUc6PoeUKDo4e4ygyUFdoUFueMawN06Zy51crBpM09ad2MKRCu2-vRhJQ6qXBCPYLTkAj0OO2mr6xCjOndICFG1gqY_Xj_h7k Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: 7db3b983562e49cfbb77c9e64b6e6cb9 Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-818754082 Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:09:54.350213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:09:54.351845 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7db3b983562e49cfbb77c9e64b6e6cb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7db3b983562e49cfbb77c9e64b6e6cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7db3b983562e49cfbb77c9e64b6e6cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7db3b983562e49cfbb77c9e64b6e6cb9"}]}] Aug 26 11:09:54.351845 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-ServerRescueNegativeTestJSON-818754082 Aug 26 11:09:54.351845 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: 7db3b983562e49cfbb77c9e64b6e6cb9 Aug 26 11:09:54.351845 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-818754082 Aug 26 11:09:54.351845 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-ServerRescueNegativeTestJSON-818754082-project Aug 26 11:09:54.351845 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:09:54.351845 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:09:54.351845 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: d6dbbabdd88c4c088bc91e6c43531318 Aug 26 11:09:54.351845 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-ServerRescueNegativeTestJSON-818754082-project Aug 26 11:09:54.351845 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:09:54.351845 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance dcc3934b-d598-47c2-9fcb-404b2fe5a478 could not be found. Aug 26 11:09:54.351845 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': 'dcc3934b-d598-47c2-9fcb-404b2fe5a478'} Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc3934b-d598-47c2-9fcb-404b2fe5a478 could not be found. Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:09:54.352689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc3934b-d598-47c2-9fcb-404b2fe5a478 could not be found. Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc3934b-d598-47c2-9fcb-404b2fe5a478 could not be found. Aug 26 11:09:54.354121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:09:54.355453 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1df2c19a-534e-4402-89d2-1c3c74eba1d8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] Returning 404 to user: Instance dcc3934b-d598-47c2-9fcb-404b2fe5a478 could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:09:54.355453 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1df2c19a-534e-4402-89d2-1c3c74eba1d8 tempest-ServerRescueNegativeTestJSON-818754082 tempest-ServerRescueNegativeTestJSON-818754082-project] 10.222.0.40 "GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478" status: 404 len: 111 microversion: 2.1 time: 0.048433 Aug 26 11:09:54.356220 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 330/641] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:09:54 2022] GET /compute/v2.1/servers/dcc3934b-d598-47c2-9fcb-404b2fe5a478 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:10:10.005181 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=23 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:10:10.005181 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:10:10.009766 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-546c34fd-37b4-4a67-900c-d7dd7e399ae3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:10.019100 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-546c34fd-37b4-4a67-900c-d7dd7e399ae3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:10.039914 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-546c34fd-37b4-4a67-900c-d7dd7e399ae3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:10.040529 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-546c34fd-37b4-4a67-900c-d7dd7e399ae3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:10.040983 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-546c34fd-37b4-4a67-900c-d7dd7e399ae3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:10.041741 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-546c34fd-37b4-4a67-900c-d7dd7e399ae3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:10.042239 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-546c34fd-37b4-4a67-900c-d7dd7e399ae3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:10.042844 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-546c34fd-37b4-4a67-900c-d7dd7e399ae3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:10.130439 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-546c34fd-37b4-4a67-900c-d7dd7e399ae3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.130628 Aug 26 11:10:10.130638 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:10:10.131126 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 312/642] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:10:09 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 11:10:10.132498 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:10:10.254282 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9e0d3e13-bda1-46ad-a670-d93557a1fbc9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:10.254794 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9e0d3e13-bda1-46ad-a670-d93557a1fbc9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:10.261249 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e0d3e13-bda1-46ad-a670-d93557a1fbc9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:10.262397 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e0d3e13-bda1-46ad-a670-d93557a1fbc9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:10.263026 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e0d3e13-bda1-46ad-a670-d93557a1fbc9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:10.263974 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e0d3e13-bda1-46ad-a670-d93557a1fbc9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:10.265713 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e0d3e13-bda1-46ad-a670-d93557a1fbc9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:10.266700 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e0d3e13-bda1-46ad-a670-d93557a1fbc9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:10.314478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9e0d3e13-bda1-46ad-a670-d93557a1fbc9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:10:10.479119 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9e0d3e13-bda1-46ad-a670-d93557a1fbc9 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 204 len: 0 microversion: 2.1 time: 0.230423 Aug 26 11:10:10.479895 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 313/643] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:10:10 2022] DELETE /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:10:10.482677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b85a5994-520f-42bd-a09d-baa824bfd6ab tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Action: 'create', calling method: .version_select at 0x7f1a687ced30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-246835179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVJKGxBEJ+GtnyJmcW4VpW2V7ferEPNNFKNpXJcIed5l2Vdsust0n1qYWJgGImtXURGhOByR5lGz040Sfc+79zjH9nhhcrjjXOzGE/xYWdJRRDfWolNkzrWiKosFns9kg=="}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:10.506514 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-b85a5994-520f-42bd-a09d-baa824bfd6ab tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Getting quotas for project d773f20240a44729b159c57c80e017ef. Resources: {'key_pairs'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:10:10.511894 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-b85a5994-520f-42bd-a09d-baa824bfd6ab tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Getting quotas for user 9e8355dc324e49d881b9f0fc5c2923ad and project d773f20240a44729b159c57c80e017ef. Resources: {'key_pairs'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:10:10.554184 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b85a5994-520f-42bd-a09d-baa824bfd6ab tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.431805 Aug 26 11:10:10.556608 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 331/644] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 11:10:10 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:10:10.564939 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4ccd17f3-c525-4e36-9167-afbe02c45d45 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:10.566682 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4ccd17f3-c525-4e36-9167-afbe02c45d45 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:10.575061 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4ccd17f3-c525-4e36-9167-afbe02c45d45 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:10.575691 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4ccd17f3-c525-4e36-9167-afbe02c45d45 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:10.576383 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4ccd17f3-c525-4e36-9167-afbe02c45d45 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:10.577653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4ccd17f3-c525-4e36-9167-afbe02c45d45 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:10.578674 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4ccd17f3-c525-4e36-9167-afbe02c45d45 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:10.579694 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4ccd17f3-c525-4e36-9167-afbe02c45d45 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:10.619397 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0853a91a-3755-4553-9908-836c3408d66b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Action: 'create', calling method: .version_select at 0x7f1a68aa0940>, body: {"keypair": {"name": "tempest-keypair-1323272780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtHROw+QezWdiAizokjGW3P2lDLy4ZtC5JCvzeq7ilCY3RwQEs5vNrXLHGHeukwzwCq5b1JD+nH4Mr9RyA4Q3SOFIHW0reTldau2/zUQVk2C6hciE5EgafECaHKpaG3gw=="}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:10.691462 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-0853a91a-3755-4553-9908-836c3408d66b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Getting quotas for project f780402b93f94d26b2fceab83c0bf485. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:10:10.697027 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-0853a91a-3755-4553-9908-836c3408d66b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Getting quotas for user 85716f53e88048af9a8fdcbe4415979c and project f780402b93f94d26b2fceab83c0bf485. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:10:10.732004 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0853a91a-3755-4553-9908-836c3408d66b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.250589 Aug 26 11:10:10.733109 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 314/645] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 11:10:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:10:10.899380 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4ccd17f3-c525-4e36-9167-afbe02c45d45 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:10.926218 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4ccd17f3-c525-4e36-9167-afbe02c45d45 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1673 microversion: 2.1 time: 0.367897 Aug 26 11:10:10.927199 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 332/646] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:10 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1673 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:11.953070 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f432cea1-a115-437b-b501-f359ac85b446 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:11.954523 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f432cea1-a115-437b-b501-f359ac85b446 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:11.967770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f432cea1-a115-437b-b501-f359ac85b446 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:11.968266 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f432cea1-a115-437b-b501-f359ac85b446 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:11.968871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f432cea1-a115-437b-b501-f359ac85b446 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:11.973537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f432cea1-a115-437b-b501-f359ac85b446 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:11.975176 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f432cea1-a115-437b-b501-f359ac85b446 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:11.975669 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f432cea1-a115-437b-b501-f359ac85b446 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:12.356925 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f432cea1-a115-437b-b501-f359ac85b446 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:12.372935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f432cea1-a115-437b-b501-f359ac85b446 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1673 microversion: 2.1 time: 0.423887 Aug 26 11:10:12.374930 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 315/647] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:11 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1673 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:13.397866 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-9f93fe3a-b0fb-4ed8-9115-bc00010b86dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:13.400252 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9f93fe3a-b0fb-4ed8-9115-bc00010b86dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:13.416871 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f93fe3a-b0fb-4ed8-9115-bc00010b86dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:13.417351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f93fe3a-b0fb-4ed8-9115-bc00010b86dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:13.417790 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f93fe3a-b0fb-4ed8-9115-bc00010b86dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:13.418543 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f93fe3a-b0fb-4ed8-9115-bc00010b86dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:13.418988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f93fe3a-b0fb-4ed8-9115-bc00010b86dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:13.424500 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9f93fe3a-b0fb-4ed8-9115-bc00010b86dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:13.520426 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-627264314", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad797925-a966-4b56-98aa-95c1629b07a2"}], "security_groups": [{"name": "tempest-securitygroup--1780539914"}], "key_name": "tempest-keypair-1323272780", "user_data": "}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:14.000914 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] validate_networks() for [('ad797925-a966-4b56-98aa-95c1629b07a2', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:10:14.360783 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9f93fe3a-b0fb-4ed8-9115-bc00010b86dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:14.380686 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-9f93fe3a-b0fb-4ed8-9115-bc00010b86dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1673 microversion: 2.1 time: 0.986641 Aug 26 11:10:14.391220 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 333/648] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:13 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1673 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:10:15.402755 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-7125b32d-59af-47a7-9b36-2711b3be2ebf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:15.403404 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-7125b32d-59af-47a7-9b36-2711b3be2ebf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:15.410489 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7125b32d-59af-47a7-9b36-2711b3be2ebf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:15.410986 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7125b32d-59af-47a7-9b36-2711b3be2ebf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:15.411425 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7125b32d-59af-47a7-9b36-2711b3be2ebf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:15.412151 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7125b32d-59af-47a7-9b36-2711b3be2ebf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:15.412605 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7125b32d-59af-47a7-9b36-2711b3be2ebf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:15.413034 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7125b32d-59af-47a7-9b36-2711b3be2ebf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:15.540621 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7125b32d-59af-47a7-9b36-2711b3be2ebf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:15.566498 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-7125b32d-59af-47a7-9b36-2711b3be2ebf tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 200 len: 1605 microversion: 2.1 time: 0.167177 Aug 26 11:10:15.598197 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 334/649] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:15 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 1605 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:10:15.923687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:10:15.925346 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:10:15.926157 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:10:15.926758 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:10:15.927455 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:10:15.948838 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:15.951387 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:15.952587 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:15.953920 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:15.955895 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:15.956336 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:15.962540 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-cabb8cd5-20de-489c-be50-e4698a99b5f1 req-a0246e9d-0480-410a-9071-55c78d028ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcad555f-f60b-409e-9075-f4fcdbbba3fe", "name": "network-vif-deleted", "tag": "65e305ab-f815-483f-8ea8-1d853476bc95"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:15.977186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-cabb8cd5-20de-489c-be50-e4698a99b5f1 req-a0246e9d-0480-410a-9071-55c78d028ca1 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:15.978185 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-cabb8cd5-20de-489c-be50-e4698a99b5f1 req-a0246e9d-0480-410a-9071-55c78d028ca1 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:15.979110 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-cabb8cd5-20de-489c-be50-e4698a99b5f1 req-a0246e9d-0480-410a-9071-55c78d028ca1 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:15.981891 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Getting quotas for project f780402b93f94d26b2fceab83c0bf485. Resources: {'instances', 'ram', 'cores'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:10:15.986763 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Getting quotas for user 85716f53e88048af9a8fdcbe4415979c and project f780402b93f94d26b2fceab83c0bf485. Resources: {'instances', 'ram', 'cores'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:10:15.997855 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-cabb8cd5-20de-489c-be50-e4698a99b5f1 req-a0246e9d-0480-410a-9071-55c78d028ca1 service nova] Creating event network-vif-deleted:65e305ab-f815-483f-8ea8-1d853476bc95 for instance fcad555f-f60b-409e-9075-f4fcdbbba3fe on hv-cinder-85236 Aug 26 11:10:15.999751 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:10:16.002245 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:10:16.007245 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-cabb8cd5-20de-489c-be50-e4698a99b5f1 req-a0246e9d-0480-410a-9071-55c78d028ca1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.406537 Aug 26 11:10:16.007877 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 335/650] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:10:16.076374 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-201bf910-1480-4dfe-a35f-9d2f3e100e80 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.564040 Aug 26 11:10:16.077719 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 316/651] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:10:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 2566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 11:10:16.091884 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-31dadd65-e3c1-4804-900b-4d38c38dfca6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:16.092684 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-31dadd65-e3c1-4804-900b-4d38c38dfca6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:16.168829 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-31dadd65-e3c1-4804-900b-4d38c38dfca6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:16.179665 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-31dadd65-e3c1-4804-900b-4d38c38dfca6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 200 len: 1241 microversion: 2.1 time: 0.093916 Aug 26 11:10:16.180212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 336/652] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:16 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:16.614591 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e9b16c7f-5513-4a6c-bd81-16c4a852a196 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:16.615355 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e9b16c7f-5513-4a6c-bd81-16c4a852a196 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:16.622136 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9b16c7f-5513-4a6c-bd81-16c4a852a196 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:16.622626 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9b16c7f-5513-4a6c-bd81-16c4a852a196 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:16.623119 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9b16c7f-5513-4a6c-bd81-16c4a852a196 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:16.623825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9b16c7f-5513-4a6c-bd81-16c4a852a196 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:16.624934 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9b16c7f-5513-4a6c-bd81-16c4a852a196 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:16.625395 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9b16c7f-5513-4a6c-bd81-16c4a852a196 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:16.641366 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-e9b16c7f-5513-4a6c-bd81-16c4a852a196 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] HTTP exception thrown: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e9b16c7f-5513-4a6c-bd81-16c4a852a196 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Request method failure captured: Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe HTTP/1.1 Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKjSOVGVlQLgvqOBCGuVuE6J9AmctPA5-WT50KJmk6og7hyiznl58L4eU8USL9q9sW-6DMk-B97hwKkUunn2mFjj-1eokM38nOsF5zAegSTmYApQhyHblXoVhFqubFUocOCfiIb6dzpHEz_BeJyfMrAgLsVFLPCYh7I6bIrqbL_N33U Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: 0fa496929354424ca7d024a8279f2e80 Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:10:16.643303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:10:16.645168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0fa496929354424ca7d024a8279f2e80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0fa496929354424ca7d024a8279f2e80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0fa496929354424ca7d024a8279f2e80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0fa496929354424ca7d024a8279f2e80"}]}] Aug 26 11:10:16.645168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:10:16.645168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 0fa496929354424ca7d024a8279f2e80 Aug 26 11:10:16.645168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:10:16.645168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeTestJSON-1686085778-project Aug 26 11:10:16.645168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:10:16.645168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:10:16.645168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 163e8be86d5640f88893c50e6f3a8af7 Aug 26 11:10:16.645168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeTestJSON-1686085778-project Aug 26 11:10:16.645168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:10:16.645168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. Aug 26 11:10:16.645168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'fcad555f-f60b-409e-9075-f4fcdbbba3fe'} Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:10:16.646360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. Aug 26 11:10:16.648112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:10:16.650168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e9b16c7f-5513-4a6c-bd81-16c4a852a196 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Returning 404 to user: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:10:16.650168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e9b16c7f-5513-4a6c-bd81-16c4a852a196 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 404 len: 111 microversion: 2.1 time: 0.035194 Aug 26 11:10:16.662876 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1146d8e9-e1bd-4307-8d0c-f5c17205073e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '.version_select at 0x7f1a687ce5e0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:16.667567 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 317/653] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:16 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:10:16.688997 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1146d8e9-e1bd-4307-8d0c-f5c17205073e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-597777171" status: 202 len: 0 microversion: 2.1 time: 0.032074 Aug 26 11:10:16.689596 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 337/654] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 26 11:10:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-597777171 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:10:17.202130 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-15e3f218-a067-40f5-9571-61b267bf9161 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:17.210984 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-15e3f218-a067-40f5-9571-61b267bf9161 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:17.217353 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-15e3f218-a067-40f5-9571-61b267bf9161 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:17.218405 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-15e3f218-a067-40f5-9571-61b267bf9161 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:17.219404 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-15e3f218-a067-40f5-9571-61b267bf9161 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:17.220332 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-15e3f218-a067-40f5-9571-61b267bf9161 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:17.220988 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-15e3f218-a067-40f5-9571-61b267bf9161 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:17.221602 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-15e3f218-a067-40f5-9571-61b267bf9161 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:17.318543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-15e3f218-a067-40f5-9571-61b267bf9161 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:17.329462 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-15e3f218-a067-40f5-9571-61b267bf9161 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 200 len: 1293 microversion: 2.1 time: 0.132664 Aug 26 11:10:17.332208 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 318/655] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:17 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 1293 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:10:17.627741 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0d7892d1-2105-4ed5-8e20-455b394b8aa0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Action: 'create', calling method: .version_select at 0x7f1a68834550>, body: {"keypair": {"name": "tempest-keypair-338274653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBqTbI0R2CRM/aiT/O+fOcShbdRD7IubWAjdGh12HzDaozgU+RwG9n/HWfPc/fCdVdkkCWNR3Umho2n0mVgN47jN9Qi1IXm3p7r2U9Rua/qK0jcQ9zH9P0RJSWV/itzPw=="}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:17.646395 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-0d7892d1-2105-4ed5-8e20-455b394b8aa0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Getting quotas for project 0fa496929354424ca7d024a8279f2e80. Resources: {'key_pairs'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:10:17.650905 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-0d7892d1-2105-4ed5-8e20-455b394b8aa0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Getting quotas for user 163e8be86d5640f88893c50e6f3a8af7 and project 0fa496929354424ca7d024a8279f2e80. Resources: {'key_pairs'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:10:17.689692 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0d7892d1-2105-4ed5-8e20-455b394b8aa0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.066505 Aug 26 11:10:17.694226 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 338/656] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 11:10:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:10:18.351927 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-bfdfe3b8-0f1b-4b5a-a5f6-7b0743e89671 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:18.352891 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-bfdfe3b8-0f1b-4b5a-a5f6-7b0743e89671 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:18.360832 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bfdfe3b8-0f1b-4b5a-a5f6-7b0743e89671 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:18.361567 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bfdfe3b8-0f1b-4b5a-a5f6-7b0743e89671 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:18.362020 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bfdfe3b8-0f1b-4b5a-a5f6-7b0743e89671 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:18.362729 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bfdfe3b8-0f1b-4b5a-a5f6-7b0743e89671 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:18.363329 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bfdfe3b8-0f1b-4b5a-a5f6-7b0743e89671 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:18.363749 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bfdfe3b8-0f1b-4b5a-a5f6-7b0743e89671 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:18.479788 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-bfdfe3b8-0f1b-4b5a-a5f6-7b0743e89671 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:18.488371 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-bfdfe3b8-0f1b-4b5a-a5f6-7b0743e89671 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 200 len: 1299 microversion: 2.1 time: 0.140450 Aug 26 11:10:18.488960 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 319/657] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:18 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 1299 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:19.512863 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3935db53-0fee-4eaf-a51b-fd15f72bd43f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:19.514233 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-3935db53-0fee-4eaf-a51b-fd15f72bd43f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:19.531646 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3935db53-0fee-4eaf-a51b-fd15f72bd43f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:19.532429 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3935db53-0fee-4eaf-a51b-fd15f72bd43f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:19.533062 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3935db53-0fee-4eaf-a51b-fd15f72bd43f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:19.534032 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3935db53-0fee-4eaf-a51b-fd15f72bd43f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:19.534670 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3935db53-0fee-4eaf-a51b-fd15f72bd43f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:19.535595 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3935db53-0fee-4eaf-a51b-fd15f72bd43f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:19.735382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2099917799", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b228cae9-e04f-418f-b036-bf43310a5e0b"}], "security_groups": [{"name": "tempest-securitygroup--526297170"}], "key_name": "tempest-keypair-338274653", "user_data": "}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:19.740729 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-3935db53-0fee-4eaf-a51b-fd15f72bd43f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:19.763959 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-3935db53-0fee-4eaf-a51b-fd15f72bd43f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 200 len: 1367 microversion: 2.1 time: 0.255431 Aug 26 11:10:19.765359 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 339/658] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:19 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:19.946064 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4a0963c1-9dae-4b7a-b1b0-0bdf47237589 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:19.946572 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4a0963c1-9dae-4b7a-b1b0-0bdf47237589 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:19.955529 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4a0963c1-9dae-4b7a-b1b0-0bdf47237589 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:19.956297 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4a0963c1-9dae-4b7a-b1b0-0bdf47237589 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:19.956885 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4a0963c1-9dae-4b7a-b1b0-0bdf47237589 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:19.958024 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4a0963c1-9dae-4b7a-b1b0-0bdf47237589 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:19.958449 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4a0963c1-9dae-4b7a-b1b0-0bdf47237589 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:19.959041 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4a0963c1-9dae-4b7a-b1b0-0bdf47237589 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:19.967134 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] validate_networks() for [('b228cae9-e04f-418f-b036-bf43310a5e0b', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:10:19.990397 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4a0963c1-9dae-4b7a-b1b0-0bdf47237589 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723/ips" status: 200 len: 150 microversion: 2.20 time: 0.214507 Aug 26 11:10:19.991022 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 340/659] 10.222.0.40 () {60 vars in 1289 bytes} [Fri Aug 26 11:10:19 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723/ips => generated 150 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 11:10:19.997377 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-27995bf3-61f8-455d-8ea1-3ff6d4173d57 req-8844e91b-db16-4ceb-ac07-1f3489b28569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1845fcd-057b-4fc1-8761-a09197883c62", "tag": "f66a5627-6854-4d78-a90c-0acc02bef2c9"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:20.010118 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-27995bf3-61f8-455d-8ea1-3ff6d4173d57 req-8844e91b-db16-4ceb-ac07-1f3489b28569 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:20.010625 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-27995bf3-61f8-455d-8ea1-3ff6d4173d57 req-8844e91b-db16-4ceb-ac07-1f3489b28569 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:20.011068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-27995bf3-61f8-455d-8ea1-3ff6d4173d57 req-8844e91b-db16-4ceb-ac07-1f3489b28569 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:20.028685 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-27995bf3-61f8-455d-8ea1-3ff6d4173d57 req-8844e91b-db16-4ceb-ac07-1f3489b28569 service nova] Creating event network-changed:f66a5627-6854-4d78-a90c-0acc02bef2c9 for instance b1845fcd-057b-4fc1-8761-a09197883c62 on hv-cinder-85236 Aug 26 11:10:20.034952 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-27995bf3-61f8-455d-8ea1-3ff6d4173d57 req-8844e91b-db16-4ceb-ac07-1f3489b28569 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042506 Aug 26 11:10:20.036189 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 341/660] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:10:20.691406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:10:20.691825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:10:20.692642 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:10:20.693046 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:10:20.693451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:10:20.702745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:20.703317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:20.703764 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:20.704497 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:20.704941 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:20.705355 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:20.723487 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Getting quotas for project 0fa496929354424ca7d024a8279f2e80. Resources: {'instances', 'ram', 'cores'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:10:20.727215 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Getting quotas for user 163e8be86d5640f88893c50e6f3a8af7 and project 0fa496929354424ca7d024a8279f2e80. Resources: {'instances', 'ram', 'cores'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:10:20.738586 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:10:20.740803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:10:20.787341 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-79538d4d-8faa-4546-82e1-a0d615e57ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:20.787962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-79538d4d-8faa-4546-82e1-a0d615e57ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:20.792825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3ac64df0-d20e-46bf-ad08-38af54c7c9e6 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.061959 Aug 26 11:10:20.799521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 320/661] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:10:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:10:20.799704 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-79538d4d-8faa-4546-82e1-a0d615e57ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:20.799704 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-79538d4d-8faa-4546-82e1-a0d615e57ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:20.799704 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-79538d4d-8faa-4546-82e1-a0d615e57ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:20.799704 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-79538d4d-8faa-4546-82e1-a0d615e57ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:20.800301 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-79538d4d-8faa-4546-82e1-a0d615e57ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:20.800301 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-79538d4d-8faa-4546-82e1-a0d615e57ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:20.809156 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-caf3f7a1-6b9f-4386-8a30-9cc614a7df87 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:20.809820 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-caf3f7a1-6b9f-4386-8a30-9cc614a7df87 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:20.882211 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-caf3f7a1-6b9f-4386-8a30-9cc614a7df87 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:20.896206 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-caf3f7a1-6b9f-4386-8a30-9cc614a7df87 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 200 len: 1237 microversion: 2.1 time: 0.093454 Aug 26 11:10:20.897381 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 321/662] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:20 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:21.006842 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-79538d4d-8faa-4546-82e1-a0d615e57ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:21.018739 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-79538d4d-8faa-4546-82e1-a0d615e57ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 200 len: 1367 microversion: 2.1 time: 0.235491 Aug 26 11:10:21.019492 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 342/663] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:20 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:10:21.926794 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-677e15fd-52bc-43d6-ac2d-6e91c05c769d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:21.927408 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-677e15fd-52bc-43d6-ac2d-6e91c05c769d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:21.935287 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-677e15fd-52bc-43d6-ac2d-6e91c05c769d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:21.935869 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-677e15fd-52bc-43d6-ac2d-6e91c05c769d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:21.936468 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-677e15fd-52bc-43d6-ac2d-6e91c05c769d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:21.937260 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-677e15fd-52bc-43d6-ac2d-6e91c05c769d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:21.937726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-677e15fd-52bc-43d6-ac2d-6e91c05c769d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:21.938416 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-677e15fd-52bc-43d6-ac2d-6e91c05c769d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:22.039369 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-677e15fd-52bc-43d6-ac2d-6e91c05c769d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:22.049016 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-554cbf4e-bc2b-4cab-bd34-7b563a58f33f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:22.050471 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-554cbf4e-bc2b-4cab-bd34-7b563a58f33f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:22.053272 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-677e15fd-52bc-43d6-ac2d-6e91c05c769d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 200 len: 1289 microversion: 2.1 time: 0.130253 Aug 26 11:10:22.054250 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 322/664] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:21 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 1289 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:22.072083 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-554cbf4e-bc2b-4cab-bd34-7b563a58f33f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:22.072588 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-554cbf4e-bc2b-4cab-bd34-7b563a58f33f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:22.073023 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-554cbf4e-bc2b-4cab-bd34-7b563a58f33f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:22.073744 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-554cbf4e-bc2b-4cab-bd34-7b563a58f33f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:22.074434 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-554cbf4e-bc2b-4cab-bd34-7b563a58f33f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:22.074869 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-554cbf4e-bc2b-4cab-bd34-7b563a58f33f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:22.296528 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0cd7dd7a-4868-49de-b5fc-651462418a48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:22.296999 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0cd7dd7a-4868-49de-b5fc-651462418a48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:22.303330 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0cd7dd7a-4868-49de-b5fc-651462418a48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:22.303834 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0cd7dd7a-4868-49de-b5fc-651462418a48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:22.304283 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0cd7dd7a-4868-49de-b5fc-651462418a48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:22.305102 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0cd7dd7a-4868-49de-b5fc-651462418a48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:22.305713 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0cd7dd7a-4868-49de-b5fc-651462418a48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:22.306219 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0cd7dd7a-4868-49de-b5fc-651462418a48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:22.313733 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-554cbf4e-bc2b-4cab-bd34-7b563a58f33f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:22.323389 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-554cbf4e-bc2b-4cab-bd34-7b563a58f33f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 200 len: 1367 microversion: 2.1 time: 0.282787 Aug 26 11:10:22.324246 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 343/665] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:22 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:22.340185 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-0cd7dd7a-4868-49de-b5fc-651462418a48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lazy-loading 'flavor' on Instance uuid f3983ebc-9955-4f0c-9ffd-0107d1a22723 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:10:22.561151 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0cd7dd7a-4868-49de-b5fc-651462418a48 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "POST /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723/action" status: 202 len: 0 microversion: 2.20 time: 0.267661 Aug 26 11:10:22.563340 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 323/666] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Aug 26 11:10:22 2022] POST /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 26 11:10:22.572802 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-6df5fd48-cfdd-47d0-8943-c81c1a8d293e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:22.573907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-6df5fd48-cfdd-47d0-8943-c81c1a8d293e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:22.586002 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6df5fd48-cfdd-47d0-8943-c81c1a8d293e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:22.587303 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6df5fd48-cfdd-47d0-8943-c81c1a8d293e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:22.588337 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6df5fd48-cfdd-47d0-8943-c81c1a8d293e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:22.589809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6df5fd48-cfdd-47d0-8943-c81c1a8d293e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:22.590954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6df5fd48-cfdd-47d0-8943-c81c1a8d293e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:22.591641 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6df5fd48-cfdd-47d0-8943-c81c1a8d293e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:22.812483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6df5fd48-cfdd-47d0-8943-c81c1a8d293e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:22.825369 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6df5fd48-cfdd-47d0-8943-c81c1a8d293e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:22.828097 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6df5fd48-cfdd-47d0-8943-c81c1a8d293e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:22.829365 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-6df5fd48-cfdd-47d0-8943-c81c1a8d293e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.261034 Aug 26 11:10:22.829910 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 344/667] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:22 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:23.077202 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4475c7ab-2af2-483b-b3e5-2ad680f2b154 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:23.077909 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4475c7ab-2af2-483b-b3e5-2ad680f2b154 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:23.085338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4475c7ab-2af2-483b-b3e5-2ad680f2b154 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:23.085918 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4475c7ab-2af2-483b-b3e5-2ad680f2b154 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:23.086454 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4475c7ab-2af2-483b-b3e5-2ad680f2b154 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:23.087258 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4475c7ab-2af2-483b-b3e5-2ad680f2b154 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:23.087786 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4475c7ab-2af2-483b-b3e5-2ad680f2b154 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:23.088278 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4475c7ab-2af2-483b-b3e5-2ad680f2b154 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:23.180958 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4475c7ab-2af2-483b-b3e5-2ad680f2b154 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:23.189728 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4475c7ab-2af2-483b-b3e5-2ad680f2b154 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 200 len: 1295 microversion: 2.1 time: 0.118160 Aug 26 11:10:23.190334 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 324/668] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:23 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 1295 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:23.346898 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a2ca6778-1c34-4b85-9f04-b2fc9f65c800 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:23.347425 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-a2ca6778-1c34-4b85-9f04-b2fc9f65c800 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:23.354181 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a2ca6778-1c34-4b85-9f04-b2fc9f65c800 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:23.354663 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a2ca6778-1c34-4b85-9f04-b2fc9f65c800 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:23.355087 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a2ca6778-1c34-4b85-9f04-b2fc9f65c800 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:23.355987 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a2ca6778-1c34-4b85-9f04-b2fc9f65c800 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:23.356628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a2ca6778-1c34-4b85-9f04-b2fc9f65c800 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:23.357057 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a2ca6778-1c34-4b85-9f04-b2fc9f65c800 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:23.589939 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-a2ca6778-1c34-4b85-9f04-b2fc9f65c800 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:23.599470 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-a2ca6778-1c34-4b85-9f04-b2fc9f65c800 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 200 len: 1367 microversion: 2.1 time: 0.257071 Aug 26 11:10:23.600259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 345/669] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:23 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:23.853797 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-81f86af5-b4f2-4256-9dda-9776a937fe56 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:23.854921 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-81f86af5-b4f2-4256-9dda-9776a937fe56 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:23.863875 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81f86af5-b4f2-4256-9dda-9776a937fe56 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:23.864873 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81f86af5-b4f2-4256-9dda-9776a937fe56 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:23.865545 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81f86af5-b4f2-4256-9dda-9776a937fe56 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:23.866533 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81f86af5-b4f2-4256-9dda-9776a937fe56 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:23.867092 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81f86af5-b4f2-4256-9dda-9776a937fe56 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:23.867734 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81f86af5-b4f2-4256-9dda-9776a937fe56 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:24.140555 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-81f86af5-b4f2-4256-9dda-9776a937fe56 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:24.153744 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-81f86af5-b4f2-4256-9dda-9776a937fe56 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:24.156405 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-81f86af5-b4f2-4256-9dda-9776a937fe56 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:24.158204 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-81f86af5-b4f2-4256-9dda-9776a937fe56 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.309096 Aug 26 11:10:24.159133 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 325/670] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:23 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:24.211182 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-64cbba98-878b-468e-b2fe-eb01592e7d53 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:24.211822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-64cbba98-878b-468e-b2fe-eb01592e7d53 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:24.219319 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-64cbba98-878b-468e-b2fe-eb01592e7d53 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:24.219802 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-64cbba98-878b-468e-b2fe-eb01592e7d53 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:24.220518 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-64cbba98-878b-468e-b2fe-eb01592e7d53 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:24.221603 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-64cbba98-878b-468e-b2fe-eb01592e7d53 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:24.222155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-64cbba98-878b-468e-b2fe-eb01592e7d53 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:24.222761 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-64cbba98-878b-468e-b2fe-eb01592e7d53 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:24.461307 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-64cbba98-878b-468e-b2fe-eb01592e7d53 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:24.473644 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-64cbba98-878b-468e-b2fe-eb01592e7d53 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 200 len: 1362 microversion: 2.1 time: 0.266500 Aug 26 11:10:24.474971 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 346/671] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:24 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:24.610992 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-5de7524e-f7ee-4fe8-9083-426489d8c009 req-b71ded5d-f605-4e37-b656-2225ff82a86d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae0c083-f8fa-4180-87ab-44015a054859", "tag": "85a81bb5-ae8a-48aa-a930-0b8c54a4bfba"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:24.621789 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-2311107f-870f-4770-9e69-1cb0fad89bb2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:24.622588 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-2311107f-870f-4770-9e69-1cb0fad89bb2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:24.623260 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-5de7524e-f7ee-4fe8-9083-426489d8c009 req-b71ded5d-f605-4e37-b656-2225ff82a86d service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:24.624643 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-5de7524e-f7ee-4fe8-9083-426489d8c009 req-b71ded5d-f605-4e37-b656-2225ff82a86d service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:24.624946 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-5de7524e-f7ee-4fe8-9083-426489d8c009 req-b71ded5d-f605-4e37-b656-2225ff82a86d service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:24.632810 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2311107f-870f-4770-9e69-1cb0fad89bb2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:24.633641 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2311107f-870f-4770-9e69-1cb0fad89bb2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:24.634176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2311107f-870f-4770-9e69-1cb0fad89bb2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:24.644083 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-5de7524e-f7ee-4fe8-9083-426489d8c009 req-b71ded5d-f605-4e37-b656-2225ff82a86d service nova] Creating event network-changed:85a81bb5-ae8a-48aa-a930-0b8c54a4bfba for instance 9ae0c083-f8fa-4180-87ab-44015a054859 on hv-cinder-85236 Aug 26 11:10:24.644298 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2311107f-870f-4770-9e69-1cb0fad89bb2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:24.644789 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2311107f-870f-4770-9e69-1cb0fad89bb2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:24.645403 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2311107f-870f-4770-9e69-1cb0fad89bb2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:24.650955 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-5de7524e-f7ee-4fe8-9083-426489d8c009 req-b71ded5d-f605-4e37-b656-2225ff82a86d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043459 Aug 26 11:10:24.652221 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 326/672] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:10:24.881278 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-2311107f-870f-4770-9e69-1cb0fad89bb2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:24.890408 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-2311107f-870f-4770-9e69-1cb0fad89bb2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 200 len: 1367 microversion: 2.1 time: 0.272445 Aug 26 11:10:24.891199 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 347/673] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:24 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:10:25.188126 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ad6ef179-5e32-4e05-98f5-741a80977709 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:25.188830 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ad6ef179-5e32-4e05-98f5-741a80977709 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:25.196703 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ad6ef179-5e32-4e05-98f5-741a80977709 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:25.197232 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ad6ef179-5e32-4e05-98f5-741a80977709 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:25.197668 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ad6ef179-5e32-4e05-98f5-741a80977709 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:25.198390 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ad6ef179-5e32-4e05-98f5-741a80977709 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:25.198838 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ad6ef179-5e32-4e05-98f5-741a80977709 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:25.199255 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ad6ef179-5e32-4e05-98f5-741a80977709 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:25.344055 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ad6ef179-5e32-4e05-98f5-741a80977709 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:25.352191 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ad6ef179-5e32-4e05-98f5-741a80977709 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:25.353629 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ad6ef179-5e32-4e05-98f5-741a80977709 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:25.355165 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ad6ef179-5e32-4e05-98f5-741a80977709 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.172508 Aug 26 11:10:25.355728 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 327/674] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:25 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:25.495226 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0927cb3a-8b89-4f61-849f-6ee14d031140 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:25.496037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0927cb3a-8b89-4f61-849f-6ee14d031140 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:25.503319 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0927cb3a-8b89-4f61-849f-6ee14d031140 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:25.503890 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0927cb3a-8b89-4f61-849f-6ee14d031140 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:25.504323 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0927cb3a-8b89-4f61-849f-6ee14d031140 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:25.505025 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0927cb3a-8b89-4f61-849f-6ee14d031140 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:25.505470 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0927cb3a-8b89-4f61-849f-6ee14d031140 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:25.505888 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0927cb3a-8b89-4f61-849f-6ee14d031140 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:25.639532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0927cb3a-8b89-4f61-849f-6ee14d031140 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:25.648272 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0927cb3a-8b89-4f61-849f-6ee14d031140 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 200 len: 1362 microversion: 2.1 time: 0.156960 Aug 26 11:10:25.649026 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 348/675] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:25 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:25.913809 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-37c398dc-b89a-448b-9feb-4318b15bc5f6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:25.914460 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-37c398dc-b89a-448b-9feb-4318b15bc5f6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:25.920496 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-37c398dc-b89a-448b-9feb-4318b15bc5f6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:25.921679 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-37c398dc-b89a-448b-9feb-4318b15bc5f6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:25.922206 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-37c398dc-b89a-448b-9feb-4318b15bc5f6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:25.922944 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-37c398dc-b89a-448b-9feb-4318b15bc5f6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:25.923496 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-37c398dc-b89a-448b-9feb-4318b15bc5f6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:25.923928 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-37c398dc-b89a-448b-9feb-4318b15bc5f6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:26.067174 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-37c398dc-b89a-448b-9feb-4318b15bc5f6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:26.076582 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-37c398dc-b89a-448b-9feb-4318b15bc5f6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 200 len: 1367 microversion: 2.1 time: 0.167939 Aug 26 11:10:26.078853 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 328/676] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:25 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:26.145930 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-fb1222db-41c4-4b12-8ee6-dfdf75bb0781 req-9385c63a-8358-454e-a2b0-667517dcbb44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1845fcd-057b-4fc1-8761-a09197883c62", "name": "network-vif-plugged", "status": "completed", "tag": "f66a5627-6854-4d78-a90c-0acc02bef2c9"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:26.156115 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-fb1222db-41c4-4b12-8ee6-dfdf75bb0781 req-9385c63a-8358-454e-a2b0-667517dcbb44 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:26.156825 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-fb1222db-41c4-4b12-8ee6-dfdf75bb0781 req-9385c63a-8358-454e-a2b0-667517dcbb44 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:26.157260 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-fb1222db-41c4-4b12-8ee6-dfdf75bb0781 req-9385c63a-8358-454e-a2b0-667517dcbb44 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:26.170354 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-fb1222db-41c4-4b12-8ee6-dfdf75bb0781 req-9385c63a-8358-454e-a2b0-667517dcbb44 service nova] Creating event network-vif-plugged:f66a5627-6854-4d78-a90c-0acc02bef2c9 for instance b1845fcd-057b-4fc1-8761-a09197883c62 on hv-cinder-85236 Aug 26 11:10:26.176013 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-fb1222db-41c4-4b12-8ee6-dfdf75bb0781 req-9385c63a-8358-454e-a2b0-667517dcbb44 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103235 Aug 26 11:10:26.176614 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 349/677] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:10:26.379600 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6ffd3770-4ece-4c85-b00f-7310875e4397 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:26.380149 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6ffd3770-4ece-4c85-b00f-7310875e4397 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:26.386223 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6ffd3770-4ece-4c85-b00f-7310875e4397 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:26.386709 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6ffd3770-4ece-4c85-b00f-7310875e4397 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:26.387147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6ffd3770-4ece-4c85-b00f-7310875e4397 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:26.387847 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6ffd3770-4ece-4c85-b00f-7310875e4397 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:26.388299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6ffd3770-4ece-4c85-b00f-7310875e4397 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:26.388716 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6ffd3770-4ece-4c85-b00f-7310875e4397 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:26.410207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:10:26.564323 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6ffd3770-4ece-4c85-b00f-7310875e4397 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:26.572962 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6ffd3770-4ece-4c85-b00f-7310875e4397 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:26.574437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6ffd3770-4ece-4c85-b00f-7310875e4397 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:26.575603 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6ffd3770-4ece-4c85-b00f-7310875e4397 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.200023 Aug 26 11:10:26.576157 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 329/678] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:26 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:26.670345 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-85143ec7-b4f3-487d-8d9c-534b9c66e0dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:26.670970 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-85143ec7-b4f3-487d-8d9c-534b9c66e0dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:26.677116 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-85143ec7-b4f3-487d-8d9c-534b9c66e0dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:26.677601 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-85143ec7-b4f3-487d-8d9c-534b9c66e0dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:26.678060 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-85143ec7-b4f3-487d-8d9c-534b9c66e0dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:26.678759 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-85143ec7-b4f3-487d-8d9c-534b9c66e0dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:26.679213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-85143ec7-b4f3-487d-8d9c-534b9c66e0dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:26.679634 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-85143ec7-b4f3-487d-8d9c-534b9c66e0dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:26.833656 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-85143ec7-b4f3-487d-8d9c-534b9c66e0dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:26.841776 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-85143ec7-b4f3-487d-8d9c-534b9c66e0dc tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 200 len: 1362 microversion: 2.1 time: 0.176141 Aug 26 11:10:26.842387 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 350/679] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:26 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:27.099633 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-60a22397-ee17-44b0-ba31-fac2ed4b8063 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:27.100241 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-60a22397-ee17-44b0-ba31-fac2ed4b8063 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:27.107827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60a22397-ee17-44b0-ba31-fac2ed4b8063 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:27.108983 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60a22397-ee17-44b0-ba31-fac2ed4b8063 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:27.109693 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60a22397-ee17-44b0-ba31-fac2ed4b8063 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:27.110971 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60a22397-ee17-44b0-ba31-fac2ed4b8063 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:27.111831 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60a22397-ee17-44b0-ba31-fac2ed4b8063 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:27.112330 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60a22397-ee17-44b0-ba31-fac2ed4b8063 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:27.250642 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-60a22397-ee17-44b0-ba31-fac2ed4b8063 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:27.258248 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-60a22397-ee17-44b0-ba31-fac2ed4b8063 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 200 len: 1367 microversion: 2.1 time: 0.162431 Aug 26 11:10:27.258814 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 330/680] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:27 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:27.600443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-8f024f9b-6e9d-4b93-a8a8-d71a02c6e3e1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:27.601060 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-8f024f9b-6e9d-4b93-a8a8-d71a02c6e3e1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:27.607072 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8f024f9b-6e9d-4b93-a8a8-d71a02c6e3e1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:27.607555 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8f024f9b-6e9d-4b93-a8a8-d71a02c6e3e1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:27.607997 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8f024f9b-6e9d-4b93-a8a8-d71a02c6e3e1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:27.609335 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8f024f9b-6e9d-4b93-a8a8-d71a02c6e3e1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:27.609791 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8f024f9b-6e9d-4b93-a8a8-d71a02c6e3e1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:27.610239 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8f024f9b-6e9d-4b93-a8a8-d71a02c6e3e1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:27.659240 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=10 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:10:27.742639 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8f024f9b-6e9d-4b93-a8a8-d71a02c6e3e1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:27.753441 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8f024f9b-6e9d-4b93-a8a8-d71a02c6e3e1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:27.754938 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8f024f9b-6e9d-4b93-a8a8-d71a02c6e3e1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:27.756104 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-8f024f9b-6e9d-4b93-a8a8-d71a02c6e3e1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.160285 Aug 26 11:10:27.756698 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 351/681] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:27 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:27.863803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ee59619f-a680-460b-bc02-766158344715 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:27.864334 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ee59619f-a680-460b-bc02-766158344715 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:27.870526 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee59619f-a680-460b-bc02-766158344715 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:27.871276 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee59619f-a680-460b-bc02-766158344715 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:27.871710 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee59619f-a680-460b-bc02-766158344715 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:27.872398 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee59619f-a680-460b-bc02-766158344715 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:27.872845 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee59619f-a680-460b-bc02-766158344715 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:27.873266 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee59619f-a680-460b-bc02-766158344715 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:28.005260 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ee59619f-a680-460b-bc02-766158344715 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:28.013162 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ee59619f-a680-460b-bc02-766158344715 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 200 len: 1362 microversion: 2.1 time: 0.153304 Aug 26 11:10:28.013873 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 331/682] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:27 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:28.280585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3a108a5e-2fe4-4c85-a5e7-61b7f8ccdab1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:28.281831 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-3a108a5e-2fe4-4c85-a5e7-61b7f8ccdab1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:28.288103 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3a108a5e-2fe4-4c85-a5e7-61b7f8ccdab1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:28.288627 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3a108a5e-2fe4-4c85-a5e7-61b7f8ccdab1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:28.289115 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3a108a5e-2fe4-4c85-a5e7-61b7f8ccdab1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:28.289834 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3a108a5e-2fe4-4c85-a5e7-61b7f8ccdab1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:28.290600 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3a108a5e-2fe4-4c85-a5e7-61b7f8ccdab1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:28.290789 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3a108a5e-2fe4-4c85-a5e7-61b7f8ccdab1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:28.445869 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-3a108a5e-2fe4-4c85-a5e7-61b7f8ccdab1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:28.455099 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-3a108a5e-2fe4-4c85-a5e7-61b7f8ccdab1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 200 len: 1556 microversion: 2.1 time: 0.179070 Aug 26 11:10:28.455952 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 352/683] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:28 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:28.477017 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a837545f-5200-42dc-85e8-647ac8e9c946 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:28.477785 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a837545f-5200-42dc-85e8-647ac8e9c946 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:28.484470 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a837545f-5200-42dc-85e8-647ac8e9c946 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:28.485053 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a837545f-5200-42dc-85e8-647ac8e9c946 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:28.485559 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a837545f-5200-42dc-85e8-647ac8e9c946 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:28.486371 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a837545f-5200-42dc-85e8-647ac8e9c946 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:28.486899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a837545f-5200-42dc-85e8-647ac8e9c946 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:28.487403 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a837545f-5200-42dc-85e8-647ac8e9c946 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:28.572764 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a837545f-5200-42dc-85e8-647ac8e9c946 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099822 Aug 26 11:10:28.573362 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 332/684] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 26 11:10:28 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:10:28.780018 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1137333f-c9d5-4199-aae5-4ef14d9840de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:28.781490 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-1137333f-c9d5-4199-aae5-4ef14d9840de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:28.788619 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1137333f-c9d5-4199-aae5-4ef14d9840de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:28.789102 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1137333f-c9d5-4199-aae5-4ef14d9840de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:28.789542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1137333f-c9d5-4199-aae5-4ef14d9840de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:28.790271 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1137333f-c9d5-4199-aae5-4ef14d9840de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:28.790722 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1137333f-c9d5-4199-aae5-4ef14d9840de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:28.791144 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1137333f-c9d5-4199-aae5-4ef14d9840de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:29.035605 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8d3320c9-bed1-4ada-9fb9-6a57e7b272d7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:29.036231 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8d3320c9-bed1-4ada-9fb9-6a57e7b272d7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:29.042604 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d3320c9-bed1-4ada-9fb9-6a57e7b272d7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:29.043868 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d3320c9-bed1-4ada-9fb9-6a57e7b272d7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:29.044320 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d3320c9-bed1-4ada-9fb9-6a57e7b272d7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:29.045096 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d3320c9-bed1-4ada-9fb9-6a57e7b272d7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:29.045561 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d3320c9-bed1-4ada-9fb9-6a57e7b272d7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:29.046901 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d3320c9-bed1-4ada-9fb9-6a57e7b272d7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:29.066305 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1137333f-c9d5-4199-aae5-4ef14d9840de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:29.070079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=100 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:10:29.081181 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1137333f-c9d5-4199-aae5-4ef14d9840de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:29.083088 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1137333f-c9d5-4199-aae5-4ef14d9840de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:29.084410 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1137333f-c9d5-4199-aae5-4ef14d9840de tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.308330 Aug 26 11:10:29.098367 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 353/685] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:28 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:29.308754 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8d3320c9-bed1-4ada-9fb9-6a57e7b272d7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:29.317308 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8d3320c9-bed1-4ada-9fb9-6a57e7b272d7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 200 len: 1362 microversion: 2.1 time: 0.285785 Aug 26 11:10:29.317891 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 333/686] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:29 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:10:29.730560 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-0cda09eb-a0dd-4dc0-bd3b-e802735aba23 req-1b0a85a7-ca9f-491d-b59b-fc85e5e1fa78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1845fcd-057b-4fc1-8761-a09197883c62", "tag": "f66a5627-6854-4d78-a90c-0acc02bef2c9"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:29.741175 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-0cda09eb-a0dd-4dc0-bd3b-e802735aba23 req-1b0a85a7-ca9f-491d-b59b-fc85e5e1fa78 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:29.741668 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-0cda09eb-a0dd-4dc0-bd3b-e802735aba23 req-1b0a85a7-ca9f-491d-b59b-fc85e5e1fa78 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:29.742136 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-0cda09eb-a0dd-4dc0-bd3b-e802735aba23 req-1b0a85a7-ca9f-491d-b59b-fc85e5e1fa78 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:29.756848 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-0cda09eb-a0dd-4dc0-bd3b-e802735aba23 req-1b0a85a7-ca9f-491d-b59b-fc85e5e1fa78 service nova] Creating event network-changed:f66a5627-6854-4d78-a90c-0acc02bef2c9 for instance b1845fcd-057b-4fc1-8761-a09197883c62 on hv-cinder-85236 Aug 26 11:10:29.762224 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-0cda09eb-a0dd-4dc0-bd3b-e802735aba23 req-1b0a85a7-ca9f-491d-b59b-fc85e5e1fa78 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035819 Aug 26 11:10:29.763251 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 354/687] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:10:29.970406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-834689670", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-246835179", "security_groups": [{"name": "tempest-secgroup-smoke-1665899742"}], "block_device_mapping_v2": [{"uuid": "2613a319-9616-4e52-9655-fe01c5d0d60d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bdfdb3db-3bbb-431b-99cd-605e0811c994"}]}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:30.110543 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3dfabb80-435e-4335-aa1e-5ce33dac0f5a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:30.113742 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-3dfabb80-435e-4335-aa1e-5ce33dac0f5a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:30.123103 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3dfabb80-435e-4335-aa1e-5ce33dac0f5a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:30.124092 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3dfabb80-435e-4335-aa1e-5ce33dac0f5a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:30.124783 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3dfabb80-435e-4335-aa1e-5ce33dac0f5a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:30.125572 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3dfabb80-435e-4335-aa1e-5ce33dac0f5a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:30.126276 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3dfabb80-435e-4335-aa1e-5ce33dac0f5a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:30.126704 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3dfabb80-435e-4335-aa1e-5ce33dac0f5a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:30.158852 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] validate_networks() for [('bdfdb3db-3bbb-431b-99cd-605e0811c994', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:10:30.688172 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-3dfabb80-435e-4335-aa1e-5ce33dac0f5a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:30.698799 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-3dfabb80-435e-4335-aa1e-5ce33dac0f5a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:30.700588 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-3dfabb80-435e-4335-aa1e-5ce33dac0f5a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:30.701759 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-3dfabb80-435e-4335-aa1e-5ce33dac0f5a tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.596541 Aug 26 11:10:30.704090 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 355/688] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:30 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:10:30.711571 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=4 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:10:30.722986 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-a6d314a4-0e14-4754-9eb0-4ae088402d4c req-d5ff3224-46ce-4a5c-b031-e4224b0eb001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae0c083-f8fa-4180-87ab-44015a054859", "name": "network-vif-plugged", "status": "completed", "tag": "85a81bb5-ae8a-48aa-a930-0b8c54a4bfba"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:30.733537 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-a6d314a4-0e14-4754-9eb0-4ae088402d4c req-d5ff3224-46ce-4a5c-b031-e4224b0eb001 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:30.734046 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-a6d314a4-0e14-4754-9eb0-4ae088402d4c req-d5ff3224-46ce-4a5c-b031-e4224b0eb001 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:30.734482 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-a6d314a4-0e14-4754-9eb0-4ae088402d4c req-d5ff3224-46ce-4a5c-b031-e4224b0eb001 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:30.755411 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-a6d314a4-0e14-4754-9eb0-4ae088402d4c req-d5ff3224-46ce-4a5c-b031-e4224b0eb001 service nova] Creating event network-vif-plugged:85a81bb5-ae8a-48aa-a930-0b8c54a4bfba for instance 9ae0c083-f8fa-4180-87ab-44015a054859 on hv-cinder-85236 Aug 26 11:10:30.762490 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-a6d314a4-0e14-4754-9eb0-4ae088402d4c req-d5ff3224-46ce-4a5c-b031-e4224b0eb001 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056157 Aug 26 11:10:30.764338 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 356/689] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:10:30.773108 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-7ef5a2d2-d226-4a12-8e88-5ea78d1f8887 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:30.774177 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-7ef5a2d2-d226-4a12-8e88-5ea78d1f8887 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:30.781545 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7ef5a2d2-d226-4a12-8e88-5ea78d1f8887 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:30.782525 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7ef5a2d2-d226-4a12-8e88-5ea78d1f8887 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:30.783304 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7ef5a2d2-d226-4a12-8e88-5ea78d1f8887 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:30.784207 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7ef5a2d2-d226-4a12-8e88-5ea78d1f8887 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:30.784847 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7ef5a2d2-d226-4a12-8e88-5ea78d1f8887 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:30.785454 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7ef5a2d2-d226-4a12-8e88-5ea78d1f8887 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:30.887139 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=18 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:10:31.152256 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7ef5a2d2-d226-4a12-8e88-5ea78d1f8887 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:31.163321 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-7ef5a2d2-d226-4a12-8e88-5ea78d1f8887 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 200 len: 1362 microversion: 2.1 time: 0.396936 Aug 26 11:10:31.164018 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 357/690] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:30 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:31.227868 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:10:31.228757 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:10:31.229309 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:10:31.229735 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:10:31.230191 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:10:31.234560 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:10:31.245550 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:31.246713 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:31.247335 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:31.248225 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:31.249518 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:31.250143 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:31.270349 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Getting quotas for project d773f20240a44729b159c57c80e017ef. Resources: {'instances', 'ram', 'cores'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:10:31.274458 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Getting quotas for user 9e8355dc324e49d881b9f0fc5c2923ad and project d773f20240a44729b159c57c80e017ef. Resources: {'instances', 'ram', 'cores'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:10:31.336703 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:10:31.339061 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2613a319-9616-4e52-9655-fe01c5d0d60d',volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:10:31.503572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-401687b7-30d1-4c3d-a92a-e46a15d80e45 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.537987 Aug 26 11:10:31.504122 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 334/691] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:10:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:10:31.522966 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-39ccefdf-6201-4ba2-8441-102f90900360 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:31.523829 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-39ccefdf-6201-4ba2-8441-102f90900360 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:31.579403 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-39ccefdf-6201-4ba2-8441-102f90900360 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:31.586439 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-39ccefdf-6201-4ba2-8441-102f90900360 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1093 microversion: 2.1 time: 0.072024 Aug 26 11:10:31.587077 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 358/692] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:31 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:10:31.727203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a5acc969-731e-4330-9864-4435125db8b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:31.727819 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a5acc969-731e-4330-9864-4435125db8b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:31.734992 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5acc969-731e-4330-9864-4435125db8b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:31.735477 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5acc969-731e-4330-9864-4435125db8b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:31.735914 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5acc969-731e-4330-9864-4435125db8b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:31.736635 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5acc969-731e-4330-9864-4435125db8b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:31.737113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5acc969-731e-4330-9864-4435125db8b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:31.737529 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5acc969-731e-4330-9864-4435125db8b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:31.896721 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a5acc969-731e-4330-9864-4435125db8b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:31.908524 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a5acc969-731e-4330-9864-4435125db8b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:31.910114 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a5acc969-731e-4330-9864-4435125db8b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:31.911735 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a5acc969-731e-4330-9864-4435125db8b0 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.188463 Aug 26 11:10:31.912536 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 335/693] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:31 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:32.188968 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-97ca3455-92a6-4cc5-8c2b-70f83815bdc5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:32.190288 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-97ca3455-92a6-4cc5-8c2b-70f83815bdc5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:32.197351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-97ca3455-92a6-4cc5-8c2b-70f83815bdc5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:32.197967 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-97ca3455-92a6-4cc5-8c2b-70f83815bdc5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:32.198521 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-97ca3455-92a6-4cc5-8c2b-70f83815bdc5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:32.199228 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-97ca3455-92a6-4cc5-8c2b-70f83815bdc5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:32.199687 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-97ca3455-92a6-4cc5-8c2b-70f83815bdc5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:32.200118 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-97ca3455-92a6-4cc5-8c2b-70f83815bdc5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:32.347335 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-97ca3455-92a6-4cc5-8c2b-70f83815bdc5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:32.355324 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-97ca3455-92a6-4cc5-8c2b-70f83815bdc5 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 200 len: 1362 microversion: 2.1 time: 0.172789 Aug 26 11:10:32.355895 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 359/694] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:32 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:32.607841 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-11ec14fb-54cb-4eb3-b8a4-386aeed65859 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:32.609033 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-11ec14fb-54cb-4eb3-b8a4-386aeed65859 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:32.615791 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11ec14fb-54cb-4eb3-b8a4-386aeed65859 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:32.616280 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11ec14fb-54cb-4eb3-b8a4-386aeed65859 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:32.616719 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11ec14fb-54cb-4eb3-b8a4-386aeed65859 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:32.617423 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11ec14fb-54cb-4eb3-b8a4-386aeed65859 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:32.617876 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11ec14fb-54cb-4eb3-b8a4-386aeed65859 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:32.618329 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11ec14fb-54cb-4eb3-b8a4-386aeed65859 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:32.682744 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-11ec14fb-54cb-4eb3-b8a4-386aeed65859 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:32.691260 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-11ec14fb-54cb-4eb3-b8a4-386aeed65859 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1191 microversion: 2.1 time: 0.087367 Aug 26 11:10:32.691840 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 336/695] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:32 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:32.938992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1a31018f-7232-4a66-a0e2-dec5a01e7900 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:32.939679 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-1a31018f-7232-4a66-a0e2-dec5a01e7900 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:32.945771 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1a31018f-7232-4a66-a0e2-dec5a01e7900 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:32.946288 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1a31018f-7232-4a66-a0e2-dec5a01e7900 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:32.946723 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1a31018f-7232-4a66-a0e2-dec5a01e7900 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:32.947420 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1a31018f-7232-4a66-a0e2-dec5a01e7900 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:32.947872 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1a31018f-7232-4a66-a0e2-dec5a01e7900 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:32.948355 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1a31018f-7232-4a66-a0e2-dec5a01e7900 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:33.087582 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1a31018f-7232-4a66-a0e2-dec5a01e7900 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:33.095824 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1a31018f-7232-4a66-a0e2-dec5a01e7900 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:33.097281 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1a31018f-7232-4a66-a0e2-dec5a01e7900 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:33.098471 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1a31018f-7232-4a66-a0e2-dec5a01e7900 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.164008 Aug 26 11:10:33.099053 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 360/696] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:32 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:33.378097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-25ec712b-0fbd-483d-8596-65d0436fc8f3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:33.378964 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-25ec712b-0fbd-483d-8596-65d0436fc8f3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:33.385098 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25ec712b-0fbd-483d-8596-65d0436fc8f3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:33.385852 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25ec712b-0fbd-483d-8596-65d0436fc8f3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:33.386337 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25ec712b-0fbd-483d-8596-65d0436fc8f3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:33.387220 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25ec712b-0fbd-483d-8596-65d0436fc8f3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:33.387685 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25ec712b-0fbd-483d-8596-65d0436fc8f3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:33.388117 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25ec712b-0fbd-483d-8596-65d0436fc8f3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:33.637357 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-25ec712b-0fbd-483d-8596-65d0436fc8f3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:33.648025 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-25ec712b-0fbd-483d-8596-65d0436fc8f3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 200 len: 1548 microversion: 2.1 time: 0.274076 Aug 26 11:10:33.648619 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 337/697] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:33 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 1548 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:33.669721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-cc64853e-1bfe-4c17-ac4a-3ac01674c63e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:33.670375 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-cc64853e-1bfe-4c17-ac4a-3ac01674c63e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:33.677370 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cc64853e-1bfe-4c17-ac4a-3ac01674c63e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:33.677909 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cc64853e-1bfe-4c17-ac4a-3ac01674c63e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:33.678371 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cc64853e-1bfe-4c17-ac4a-3ac01674c63e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:33.679091 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cc64853e-1bfe-4c17-ac4a-3ac01674c63e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:33.679568 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cc64853e-1bfe-4c17-ac4a-3ac01674c63e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:33.680139 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cc64853e-1bfe-4c17-ac4a-3ac01674c63e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:33.713467 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1db5dce9-a539-4a4c-871c-cec770650659 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:33.714498 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1db5dce9-a539-4a4c-871c-cec770650659 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:33.721290 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1db5dce9-a539-4a4c-871c-cec770650659 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:33.722137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1db5dce9-a539-4a4c-871c-cec770650659 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:33.722679 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1db5dce9-a539-4a4c-871c-cec770650659 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:33.723472 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1db5dce9-a539-4a4c-871c-cec770650659 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:33.723992 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1db5dce9-a539-4a4c-871c-cec770650659 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:33.724502 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1db5dce9-a539-4a4c-871c-cec770650659 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:33.833939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1db5dce9-a539-4a4c-871c-cec770650659 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:33.843358 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1db5dce9-a539-4a4c-871c-cec770650659 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1209 microversion: 2.1 time: 0.133677 Aug 26 11:10:33.844822 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 338/698] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:33 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1209 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:10:33.857418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-cc64853e-1bfe-4c17-ac4a-3ac01674c63e tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.191719 Aug 26 11:10:33.858558 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 361/699] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 26 11:10:33 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-interface => generated 285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:10:34.121943 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-17b590f5-2b29-4837-967c-b65c2ae2936d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:34.122576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-17b590f5-2b29-4837-967c-b65c2ae2936d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:34.130345 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-17b590f5-2b29-4837-967c-b65c2ae2936d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:34.131287 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-17b590f5-2b29-4837-967c-b65c2ae2936d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:34.132812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-17b590f5-2b29-4837-967c-b65c2ae2936d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:34.132812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-17b590f5-2b29-4837-967c-b65c2ae2936d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:34.133046 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-17b590f5-2b29-4837-967c-b65c2ae2936d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:34.133621 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-17b590f5-2b29-4837-967c-b65c2ae2936d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:34.413442 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-17b590f5-2b29-4837-967c-b65c2ae2936d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:34.423237 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-17b590f5-2b29-4837-967c-b65c2ae2936d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:34.424697 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-17b590f5-2b29-4837-967c-b65c2ae2936d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:34.425876 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-17b590f5-2b29-4837-967c-b65c2ae2936d tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.308386 Aug 26 11:10:34.426867 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 339/700] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:34 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:34.867218 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-efd0dd9f-6273-4f68-9ce5-c429c545d887 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:34.868769 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-efd0dd9f-6273-4f68-9ce5-c429c545d887 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:34.879564 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-efd0dd9f-6273-4f68-9ce5-c429c545d887 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:34.880140 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-efd0dd9f-6273-4f68-9ce5-c429c545d887 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:34.880583 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-efd0dd9f-6273-4f68-9ce5-c429c545d887 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:34.881579 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-efd0dd9f-6273-4f68-9ce5-c429c545d887 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:34.882086 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-efd0dd9f-6273-4f68-9ce5-c429c545d887 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:34.882697 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-efd0dd9f-6273-4f68-9ce5-c429c545d887 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:35.130076 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-efd0dd9f-6273-4f68-9ce5-c429c545d887 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:35.150249 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-efd0dd9f-6273-4f68-9ce5-c429c545d887 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1265 microversion: 2.1 time: 0.287879 Aug 26 11:10:35.152430 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 362/701] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:34 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1265 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:35.194565 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-401aa5d7-9d9c-4fcf-9a16-f7336c0e41e9 req-bcc6142e-2d59-4484-8e20-b10fd2d4fb10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5e7d29e-0b68-4fea-9855-e1250c542c1b", "tag": "3ad3e811-600f-48c6-90d1-8ccbd04adc1c"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:35.209481 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-401aa5d7-9d9c-4fcf-9a16-f7336c0e41e9 req-bcc6142e-2d59-4484-8e20-b10fd2d4fb10 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:35.210002 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-401aa5d7-9d9c-4fcf-9a16-f7336c0e41e9 req-bcc6142e-2d59-4484-8e20-b10fd2d4fb10 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:35.210446 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-401aa5d7-9d9c-4fcf-9a16-f7336c0e41e9 req-bcc6142e-2d59-4484-8e20-b10fd2d4fb10 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:35.231165 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-16eb27b5-0c2b-4be0-91fb-3e2d64cdc009 req-7d96a7dc-f9b8-4ad6-8fb1-98bf1792cf00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae0c083-f8fa-4180-87ab-44015a054859", "tag": "85a81bb5-ae8a-48aa-a930-0b8c54a4bfba"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:35.236461 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-401aa5d7-9d9c-4fcf-9a16-f7336c0e41e9 req-bcc6142e-2d59-4484-8e20-b10fd2d4fb10 service nova] Creating event network-changed:3ad3e811-600f-48c6-90d1-8ccbd04adc1c for instance d5e7d29e-0b68-4fea-9855-e1250c542c1b on hv-cinder-85236 Aug 26 11:10:35.242752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-401aa5d7-9d9c-4fcf-9a16-f7336c0e41e9 req-bcc6142e-2d59-4484-8e20-b10fd2d4fb10 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051730 Aug 26 11:10:35.243952 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 363/702] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:10:35.272165 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-16eb27b5-0c2b-4be0-91fb-3e2d64cdc009 req-7d96a7dc-f9b8-4ad6-8fb1-98bf1792cf00 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:35.273846 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-16eb27b5-0c2b-4be0-91fb-3e2d64cdc009 req-7d96a7dc-f9b8-4ad6-8fb1-98bf1792cf00 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:35.274569 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-16eb27b5-0c2b-4be0-91fb-3e2d64cdc009 req-7d96a7dc-f9b8-4ad6-8fb1-98bf1792cf00 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:35.293119 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-16eb27b5-0c2b-4be0-91fb-3e2d64cdc009 req-7d96a7dc-f9b8-4ad6-8fb1-98bf1792cf00 service nova] Creating event network-changed:85a81bb5-ae8a-48aa-a930-0b8c54a4bfba for instance 9ae0c083-f8fa-4180-87ab-44015a054859 on hv-cinder-85236 Aug 26 11:10:35.301369 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-16eb27b5-0c2b-4be0-91fb-3e2d64cdc009 req-7d96a7dc-f9b8-4ad6-8fb1-98bf1792cf00 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171659 Aug 26 11:10:35.302654 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 340/703] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:10:35.464482 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b5eb8119-f6e7-4019-9d3a-84adbd611661 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:35.465607 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b5eb8119-f6e7-4019-9d3a-84adbd611661 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:35.472726 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b5eb8119-f6e7-4019-9d3a-84adbd611661 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:35.473608 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b5eb8119-f6e7-4019-9d3a-84adbd611661 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:35.474311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b5eb8119-f6e7-4019-9d3a-84adbd611661 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:35.475340 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b5eb8119-f6e7-4019-9d3a-84adbd611661 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:35.476101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b5eb8119-f6e7-4019-9d3a-84adbd611661 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:35.476815 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b5eb8119-f6e7-4019-9d3a-84adbd611661 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:35.708042 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b5eb8119-f6e7-4019-9d3a-84adbd611661 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:35.720088 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b5eb8119-f6e7-4019-9d3a-84adbd611661 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:35.722794 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b5eb8119-f6e7-4019-9d3a-84adbd611661 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:35.726198 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b5eb8119-f6e7-4019-9d3a-84adbd611661 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.266179 Aug 26 11:10:35.728005 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 364/704] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:35 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:36.188205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-72670a8d-c04a-46d8-adb1-19e27498ba34 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:36.188927 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-72670a8d-c04a-46d8-adb1-19e27498ba34 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:36.197026 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-72670a8d-c04a-46d8-adb1-19e27498ba34 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:36.197862 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-72670a8d-c04a-46d8-adb1-19e27498ba34 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:36.198544 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-72670a8d-c04a-46d8-adb1-19e27498ba34 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:36.199288 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-72670a8d-c04a-46d8-adb1-19e27498ba34 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:36.199747 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-72670a8d-c04a-46d8-adb1-19e27498ba34 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:36.200197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-72670a8d-c04a-46d8-adb1-19e27498ba34 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:36.459968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-72670a8d-c04a-46d8-adb1-19e27498ba34 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:36.469554 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-72670a8d-c04a-46d8-adb1-19e27498ba34 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1265 microversion: 2.1 time: 0.290736 Aug 26 11:10:36.470205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 341/705] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:36 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1265 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:36.753950 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b1659b98-4164-4b70-a824-624cb8feaead tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:36.754584 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b1659b98-4164-4b70-a824-624cb8feaead tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:36.761356 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1659b98-4164-4b70-a824-624cb8feaead tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:36.761840 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1659b98-4164-4b70-a824-624cb8feaead tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:36.762302 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1659b98-4164-4b70-a824-624cb8feaead tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:36.763002 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1659b98-4164-4b70-a824-624cb8feaead tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:36.763451 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1659b98-4164-4b70-a824-624cb8feaead tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:36.763922 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1659b98-4164-4b70-a824-624cb8feaead tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:36.904280 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b1659b98-4164-4b70-a824-624cb8feaead tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:36.912955 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b1659b98-4164-4b70-a824-624cb8feaead tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:36.914480 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b1659b98-4164-4b70-a824-624cb8feaead tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:36.915719 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b1659b98-4164-4b70-a824-624cb8feaead tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.165972 Aug 26 11:10:36.916291 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 365/706] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:36 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:37.491467 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0a3b4727-b623-4454-b072-7a469f378433 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:37.492107 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0a3b4727-b623-4454-b072-7a469f378433 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:37.499821 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a3b4727-b623-4454-b072-7a469f378433 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:37.500238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a3b4727-b623-4454-b072-7a469f378433 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:37.500677 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a3b4727-b623-4454-b072-7a469f378433 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:37.501392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a3b4727-b623-4454-b072-7a469f378433 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:37.501843 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a3b4727-b623-4454-b072-7a469f378433 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:37.502301 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a3b4727-b623-4454-b072-7a469f378433 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:37.640779 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0a3b4727-b623-4454-b072-7a469f378433 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:37.648724 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0a3b4727-b623-4454-b072-7a469f378433 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1265 microversion: 2.1 time: 0.161288 Aug 26 11:10:37.649301 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 342/707] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:37 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:10:37.940682 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f4545a8c-c857-4e8d-a0c2-97ea972897a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:37.941327 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f4545a8c-c857-4e8d-a0c2-97ea972897a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:37.950194 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4545a8c-c857-4e8d-a0c2-97ea972897a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:37.951401 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4545a8c-c857-4e8d-a0c2-97ea972897a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:37.953243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4545a8c-c857-4e8d-a0c2-97ea972897a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:37.954579 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4545a8c-c857-4e8d-a0c2-97ea972897a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:37.955410 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4545a8c-c857-4e8d-a0c2-97ea972897a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:37.956153 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4545a8c-c857-4e8d-a0c2-97ea972897a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:38.102335 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f4545a8c-c857-4e8d-a0c2-97ea972897a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:38.112589 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f4545a8c-c857-4e8d-a0c2-97ea972897a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:38.114061 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f4545a8c-c857-4e8d-a0c2-97ea972897a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:38.115221 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f4545a8c-c857-4e8d-a0c2-97ea972897a1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.179348 Aug 26 11:10:38.115784 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 366/708] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:37 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:38.670688 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-201094d1-3dbf-4a60-be7e-9a55e6993705 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:38.671642 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-201094d1-3dbf-4a60-be7e-9a55e6993705 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:38.678608 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-201094d1-3dbf-4a60-be7e-9a55e6993705 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:38.679092 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-201094d1-3dbf-4a60-be7e-9a55e6993705 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:38.679522 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-201094d1-3dbf-4a60-be7e-9a55e6993705 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:38.680222 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-201094d1-3dbf-4a60-be7e-9a55e6993705 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:38.680669 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-201094d1-3dbf-4a60-be7e-9a55e6993705 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:38.681087 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-201094d1-3dbf-4a60-be7e-9a55e6993705 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:38.843545 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-201094d1-3dbf-4a60-be7e-9a55e6993705 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:38.851258 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-201094d1-3dbf-4a60-be7e-9a55e6993705 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1265 microversion: 2.1 time: 0.184489 Aug 26 11:10:38.851840 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 343/709] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:38 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:39.139885 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-bbc409b6-d378-433e-95a3-42cd6d09a550 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:39.140890 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-bbc409b6-d378-433e-95a3-42cd6d09a550 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:39.145462 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:10:39.149808 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bbc409b6-d378-433e-95a3-42cd6d09a550 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:39.150319 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bbc409b6-d378-433e-95a3-42cd6d09a550 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:39.150749 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bbc409b6-d378-433e-95a3-42cd6d09a550 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:39.151450 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bbc409b6-d378-433e-95a3-42cd6d09a550 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:39.151904 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bbc409b6-d378-433e-95a3-42cd6d09a550 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:39.152324 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bbc409b6-d378-433e-95a3-42cd6d09a550 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:39.297909 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-bbc409b6-d378-433e-95a3-42cd6d09a550 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:39.306973 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-bbc409b6-d378-433e-95a3-42cd6d09a550 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:39.308419 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-bbc409b6-d378-433e-95a3-42cd6d09a550 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:39.309587 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-bbc409b6-d378-433e-95a3-42cd6d09a550 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.174338 Aug 26 11:10:39.310179 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 367/710] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:39 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:39.875394 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7948ca46-14cc-47d0-943d-946d31feb806 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:39.876626 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7948ca46-14cc-47d0-943d-946d31feb806 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:39.883468 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7948ca46-14cc-47d0-943d-946d31feb806 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:39.883957 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7948ca46-14cc-47d0-943d-946d31feb806 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:39.884393 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7948ca46-14cc-47d0-943d-946d31feb806 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:39.885100 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7948ca46-14cc-47d0-943d-946d31feb806 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:39.885550 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7948ca46-14cc-47d0-943d-946d31feb806 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:39.885992 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7948ca46-14cc-47d0-943d-946d31feb806 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:40.044296 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7948ca46-14cc-47d0-943d-946d31feb806 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:40.056663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7948ca46-14cc-47d0-943d-946d31feb806 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1265 microversion: 2.1 time: 0.185881 Aug 26 11:10:40.057254 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 344/711] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:39 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:40.334721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f8702a6d-3ac5-48d1-b780-226781d4485b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:40.335749 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f8702a6d-3ac5-48d1-b780-226781d4485b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:40.346568 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f8702a6d-3ac5-48d1-b780-226781d4485b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:40.347979 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f8702a6d-3ac5-48d1-b780-226781d4485b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:40.348718 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f8702a6d-3ac5-48d1-b780-226781d4485b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:40.349926 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f8702a6d-3ac5-48d1-b780-226781d4485b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:40.350420 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f8702a6d-3ac5-48d1-b780-226781d4485b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:40.351000 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f8702a6d-3ac5-48d1-b780-226781d4485b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:40.490317 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f8702a6d-3ac5-48d1-b780-226781d4485b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:40.499229 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f8702a6d-3ac5-48d1-b780-226781d4485b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:40.500693 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f8702a6d-3ac5-48d1-b780-226781d4485b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:40.501914 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f8702a6d-3ac5-48d1-b780-226781d4485b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.172266 Aug 26 11:10:40.502831 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 368/712] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:40 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:10:41.078738 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ac93ff0d-ad53-4791-ad66-a2b4b5d8ac17 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:41.079359 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ac93ff0d-ad53-4791-ad66-a2b4b5d8ac17 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:41.087875 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac93ff0d-ad53-4791-ad66-a2b4b5d8ac17 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:41.088697 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac93ff0d-ad53-4791-ad66-a2b4b5d8ac17 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:41.089464 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac93ff0d-ad53-4791-ad66-a2b4b5d8ac17 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:41.090561 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac93ff0d-ad53-4791-ad66-a2b4b5d8ac17 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:41.091190 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac93ff0d-ad53-4791-ad66-a2b4b5d8ac17 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:41.091870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac93ff0d-ad53-4791-ad66-a2b4b5d8ac17 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:41.236837 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ac93ff0d-ad53-4791-ad66-a2b4b5d8ac17 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:41.245013 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ac93ff0d-ad53-4791-ad66-a2b4b5d8ac17 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1265 microversion: 2.1 time: 0.170769 Aug 26 11:10:41.245587 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 345/713] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:41 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:41.524798 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-e8bbae5c-576b-4009-b675-3b8f93f0c7ae tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:41.525393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e8bbae5c-576b-4009-b675-3b8f93f0c7ae tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:41.533027 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e8bbae5c-576b-4009-b675-3b8f93f0c7ae tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:41.533513 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e8bbae5c-576b-4009-b675-3b8f93f0c7ae tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:41.533954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e8bbae5c-576b-4009-b675-3b8f93f0c7ae tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:41.534679 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e8bbae5c-576b-4009-b675-3b8f93f0c7ae tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:41.535130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e8bbae5c-576b-4009-b675-3b8f93f0c7ae tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:41.535545 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e8bbae5c-576b-4009-b675-3b8f93f0c7ae tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:41.584127 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:10:41.671498 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-e8bbae5c-576b-4009-b675-3b8f93f0c7ae tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:41.679924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-e8bbae5c-576b-4009-b675-3b8f93f0c7ae tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:41.681356 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-e8bbae5c-576b-4009-b675-3b8f93f0c7ae tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:41.682553 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-e8bbae5c-576b-4009-b675-3b8f93f0c7ae tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.161767 Aug 26 11:10:41.683112 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 369/714] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:41 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:42.266716 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-98563111-bff0-478e-ab08-a15324300efc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:42.267328 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-98563111-bff0-478e-ab08-a15324300efc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:42.269287 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:10:42.269944 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=6 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:10:42.276443 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98563111-bff0-478e-ab08-a15324300efc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:42.276937 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98563111-bff0-478e-ab08-a15324300efc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:42.277374 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98563111-bff0-478e-ab08-a15324300efc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:42.278104 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98563111-bff0-478e-ab08-a15324300efc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:42.278577 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98563111-bff0-478e-ab08-a15324300efc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:42.278983 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98563111-bff0-478e-ab08-a15324300efc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:42.418826 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-98563111-bff0-478e-ab08-a15324300efc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:42.427404 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-98563111-bff0-478e-ab08-a15324300efc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1265 microversion: 2.1 time: 0.165030 Aug 26 11:10:42.427981 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 346/715] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:42 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:42.707714 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0a05617e-c9dd-4ab0-98cf-b0de33370414 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:42.708497 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0a05617e-c9dd-4ab0-98cf-b0de33370414 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:42.714992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0a05617e-c9dd-4ab0-98cf-b0de33370414 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:42.715477 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0a05617e-c9dd-4ab0-98cf-b0de33370414 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:42.715910 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0a05617e-c9dd-4ab0-98cf-b0de33370414 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:42.716621 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0a05617e-c9dd-4ab0-98cf-b0de33370414 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:42.717071 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0a05617e-c9dd-4ab0-98cf-b0de33370414 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:42.717695 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0a05617e-c9dd-4ab0-98cf-b0de33370414 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:42.855303 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0a05617e-c9dd-4ab0-98cf-b0de33370414 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:42.863849 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0a05617e-c9dd-4ab0-98cf-b0de33370414 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:42.865282 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0a05617e-c9dd-4ab0-98cf-b0de33370414 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:42.866482 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0a05617e-c9dd-4ab0-98cf-b0de33370414 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.162872 Aug 26 11:10:42.867075 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 370/716] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:42 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:43.448927 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e360b0fc-b1d0-4b21-be1c-269405c32046 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:43.449541 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e360b0fc-b1d0-4b21-be1c-269405c32046 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:43.457309 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e360b0fc-b1d0-4b21-be1c-269405c32046 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:43.457803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e360b0fc-b1d0-4b21-be1c-269405c32046 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:43.458275 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e360b0fc-b1d0-4b21-be1c-269405c32046 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:43.458992 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e360b0fc-b1d0-4b21-be1c-269405c32046 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:43.459450 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e360b0fc-b1d0-4b21-be1c-269405c32046 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:43.459882 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e360b0fc-b1d0-4b21-be1c-269405c32046 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:43.596118 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e360b0fc-b1d0-4b21-be1c-269405c32046 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:43.599504 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=100 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:10:43.604924 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e360b0fc-b1d0-4b21-be1c-269405c32046 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1265 microversion: 2.1 time: 0.159850 Aug 26 11:10:43.605478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 347/717] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:43 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:10:43.890455 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-65413ec5-2d5e-40c7-abda-e2e3c4ba4d69 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:43.891070 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-65413ec5-2d5e-40c7-abda-e2e3c4ba4d69 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:43.897475 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-65413ec5-2d5e-40c7-abda-e2e3c4ba4d69 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:43.897961 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-65413ec5-2d5e-40c7-abda-e2e3c4ba4d69 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:43.898435 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-65413ec5-2d5e-40c7-abda-e2e3c4ba4d69 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:43.899143 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-65413ec5-2d5e-40c7-abda-e2e3c4ba4d69 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:43.899592 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-65413ec5-2d5e-40c7-abda-e2e3c4ba4d69 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:43.900005 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-65413ec5-2d5e-40c7-abda-e2e3c4ba4d69 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:44.050278 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-65413ec5-2d5e-40c7-abda-e2e3c4ba4d69 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:44.058466 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-65413ec5-2d5e-40c7-abda-e2e3c4ba4d69 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:44.059994 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-65413ec5-2d5e-40c7-abda-e2e3c4ba4d69 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:44.061772 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-65413ec5-2d5e-40c7-abda-e2e3c4ba4d69 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1741 microversion: 2.20 time: 0.174661 Aug 26 11:10:44.062298 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 371/718] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:43 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:44.630094 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2767443d-53c4-4823-881a-c1dda596eb3a tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:44.631088 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2767443d-53c4-4823-881a-c1dda596eb3a tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:44.641788 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2767443d-53c4-4823-881a-c1dda596eb3a tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:44.642798 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2767443d-53c4-4823-881a-c1dda596eb3a tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:44.643373 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2767443d-53c4-4823-881a-c1dda596eb3a tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:44.644703 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2767443d-53c4-4823-881a-c1dda596eb3a tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:44.645513 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2767443d-53c4-4823-881a-c1dda596eb3a tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:44.646320 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2767443d-53c4-4823-881a-c1dda596eb3a tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:44.809029 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2767443d-53c4-4823-881a-c1dda596eb3a tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:44.817550 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2767443d-53c4-4823-881a-c1dda596eb3a tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1265 microversion: 2.1 time: 0.194407 Aug 26 11:10:44.818159 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 348/719] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:44 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:45.085011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-db3cd1e4-42d5-405d-b957-5d72602c98f5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:45.085550 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-db3cd1e4-42d5-405d-b957-5d72602c98f5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:45.092037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db3cd1e4-42d5-405d-b957-5d72602c98f5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:45.093198 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db3cd1e4-42d5-405d-b957-5d72602c98f5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:45.093648 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db3cd1e4-42d5-405d-b957-5d72602c98f5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:45.094375 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db3cd1e4-42d5-405d-b957-5d72602c98f5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:45.094836 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db3cd1e4-42d5-405d-b957-5d72602c98f5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:45.095258 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db3cd1e4-42d5-405d-b957-5d72602c98f5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:45.235991 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-db3cd1e4-42d5-405d-b957-5d72602c98f5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:45.245153 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-db3cd1e4-42d5-405d-b957-5d72602c98f5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:45.246933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-db3cd1e4-42d5-405d-b957-5d72602c98f5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:45.248106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-db3cd1e4-42d5-405d-b957-5d72602c98f5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1741 microversion: 2.20 time: 0.167235 Aug 26 11:10:45.248805 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 372/720] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:45 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:45.840678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d6e644c7-ef1e-4407-8459-347459039117 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:45.841372 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d6e644c7-ef1e-4407-8459-347459039117 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:45.849727 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6e644c7-ef1e-4407-8459-347459039117 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:45.850247 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6e644c7-ef1e-4407-8459-347459039117 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:45.850683 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6e644c7-ef1e-4407-8459-347459039117 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:45.851383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6e644c7-ef1e-4407-8459-347459039117 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:45.851831 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6e644c7-ef1e-4407-8459-347459039117 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:45.852242 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6e644c7-ef1e-4407-8459-347459039117 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:46.004261 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d6e644c7-ef1e-4407-8459-347459039117 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:46.013867 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d6e644c7-ef1e-4407-8459-347459039117 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1265 microversion: 2.1 time: 0.177279 Aug 26 11:10:46.015015 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 349/721] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:45 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:46.273379 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-29e9d66b-5a61-463e-9992-4ba69698c1fc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:46.274857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-29e9d66b-5a61-463e-9992-4ba69698c1fc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:46.285602 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29e9d66b-5a61-463e-9992-4ba69698c1fc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:46.286109 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29e9d66b-5a61-463e-9992-4ba69698c1fc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:46.286823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29e9d66b-5a61-463e-9992-4ba69698c1fc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:46.287595 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29e9d66b-5a61-463e-9992-4ba69698c1fc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:46.288134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29e9d66b-5a61-463e-9992-4ba69698c1fc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:46.289104 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29e9d66b-5a61-463e-9992-4ba69698c1fc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:46.333249 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-3455fb78-6659-4986-a2c8-d34581d3896e req-89f5044e-6bad-42a5-adfc-192a325081d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e7d29e-0b68-4fea-9855-e1250c542c1b", "name": "network-vif-plugged", "status": "completed", "tag": "3ad3e811-600f-48c6-90d1-8ccbd04adc1c"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:46.352127 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-3455fb78-6659-4986-a2c8-d34581d3896e req-89f5044e-6bad-42a5-adfc-192a325081d1 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:46.352850 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-3455fb78-6659-4986-a2c8-d34581d3896e req-89f5044e-6bad-42a5-adfc-192a325081d1 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:46.353667 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-3455fb78-6659-4986-a2c8-d34581d3896e req-89f5044e-6bad-42a5-adfc-192a325081d1 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:46.392021 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-3455fb78-6659-4986-a2c8-d34581d3896e req-89f5044e-6bad-42a5-adfc-192a325081d1 service nova] Creating event network-vif-plugged:3ad3e811-600f-48c6-90d1-8ccbd04adc1c for instance d5e7d29e-0b68-4fea-9855-e1250c542c1b on hv-cinder-85236 Aug 26 11:10:46.407718 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-3455fb78-6659-4986-a2c8-d34581d3896e req-89f5044e-6bad-42a5-adfc-192a325081d1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080803 Aug 26 11:10:46.409474 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 350/722] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:10:46.519198 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-29e9d66b-5a61-463e-9992-4ba69698c1fc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:46.525928 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=100 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:10:46.529583 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-29e9d66b-5a61-463e-9992-4ba69698c1fc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:46.532143 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-29e9d66b-5a61-463e-9992-4ba69698c1fc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:46.534649 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-29e9d66b-5a61-463e-9992-4ba69698c1fc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1736 microversion: 2.20 time: 0.266034 Aug 26 11:10:46.535786 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 373/723] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:46 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1736 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:47.036947 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b86fb040-74cf-49d5-99f3-2bf5b5963623 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:47.038400 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b86fb040-74cf-49d5-99f3-2bf5b5963623 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:47.049357 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b86fb040-74cf-49d5-99f3-2bf5b5963623 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:47.050430 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b86fb040-74cf-49d5-99f3-2bf5b5963623 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:47.050653 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b86fb040-74cf-49d5-99f3-2bf5b5963623 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:47.051561 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b86fb040-74cf-49d5-99f3-2bf5b5963623 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:47.052174 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b86fb040-74cf-49d5-99f3-2bf5b5963623 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:47.052751 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b86fb040-74cf-49d5-99f3-2bf5b5963623 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:47.206011 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b86fb040-74cf-49d5-99f3-2bf5b5963623 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:47.224031 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b86fb040-74cf-49d5-99f3-2bf5b5963623 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1265 microversion: 2.1 time: 0.190814 Aug 26 11:10:47.224902 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 351/724] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:47 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:47.578815 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-542675a2-0b9f-456d-ac21-c673ca7eec03 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:47.580091 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-542675a2-0b9f-456d-ac21-c673ca7eec03 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:47.587981 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-542675a2-0b9f-456d-ac21-c673ca7eec03 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:47.588720 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-542675a2-0b9f-456d-ac21-c673ca7eec03 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:47.589317 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-542675a2-0b9f-456d-ac21-c673ca7eec03 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:47.590216 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-542675a2-0b9f-456d-ac21-c673ca7eec03 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:47.590664 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-542675a2-0b9f-456d-ac21-c673ca7eec03 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:47.591087 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-542675a2-0b9f-456d-ac21-c673ca7eec03 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:47.771418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-542675a2-0b9f-456d-ac21-c673ca7eec03 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:47.785446 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-542675a2-0b9f-456d-ac21-c673ca7eec03 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:47.788072 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-542675a2-0b9f-456d-ac21-c673ca7eec03 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:47.790173 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-542675a2-0b9f-456d-ac21-c673ca7eec03 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1736 microversion: 2.20 time: 0.215569 Aug 26 11:10:47.791015 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 374/725] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:47 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:48.264726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4553bc28-5a1b-48f7-909a-f4553274ddef tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:48.266135 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4553bc28-5a1b-48f7-909a-f4553274ddef tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:48.285605 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4553bc28-5a1b-48f7-909a-f4553274ddef tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:48.286144 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4553bc28-5a1b-48f7-909a-f4553274ddef tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:48.286808 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4553bc28-5a1b-48f7-909a-f4553274ddef tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:48.287543 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4553bc28-5a1b-48f7-909a-f4553274ddef tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:48.288003 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4553bc28-5a1b-48f7-909a-f4553274ddef tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:48.288435 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4553bc28-5a1b-48f7-909a-f4553274ddef tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:48.437350 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-1fbf130b-15db-4fa9-953c-2b599d38cb00 req-cab76340-c5d2-4b5b-ad8d-71f1e98d47cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3983ebc-9955-4f0c-9ffd-0107d1a22723", "name": "network-vif-plugged", "status": "completed", "tag": "6d309e62-5a5f-4a29-b1a7-66190210585a"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:48.447199 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4553bc28-5a1b-48f7-909a-f4553274ddef tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:48.451108 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-1fbf130b-15db-4fa9-953c-2b599d38cb00 req-cab76340-c5d2-4b5b-ad8d-71f1e98d47cb service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:48.452965 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-1fbf130b-15db-4fa9-953c-2b599d38cb00 req-cab76340-c5d2-4b5b-ad8d-71f1e98d47cb service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:48.453729 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-1fbf130b-15db-4fa9-953c-2b599d38cb00 req-cab76340-c5d2-4b5b-ad8d-71f1e98d47cb service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:48.455990 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4553bc28-5a1b-48f7-909a-f4553274ddef tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1452 microversion: 2.1 time: 0.196316 Aug 26 11:10:48.457148 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 352/726] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:48 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1452 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:48.467626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-1fbf130b-15db-4fa9-953c-2b599d38cb00 req-cab76340-c5d2-4b5b-ad8d-71f1e98d47cb service nova] Creating event network-vif-plugged:6d309e62-5a5f-4a29-b1a7-66190210585a for instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 on hv-cinder-85236 Aug 26 11:10:48.475831 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-1fbf130b-15db-4fa9-953c-2b599d38cb00 req-cab76340-c5d2-4b5b-ad8d-71f1e98d47cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043431 Aug 26 11:10:48.478109 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6c5c2d1f-3262-42d7-9b17-1781ed6c616f tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:48.479809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 375/727] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:10:48.480307 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6c5c2d1f-3262-42d7-9b17-1781ed6c616f tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:48.487915 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6c5c2d1f-3262-42d7-9b17-1781ed6c616f tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:48.488538 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6c5c2d1f-3262-42d7-9b17-1781ed6c616f tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:48.489231 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6c5c2d1f-3262-42d7-9b17-1781ed6c616f tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:48.490037 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6c5c2d1f-3262-42d7-9b17-1781ed6c616f tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:48.490661 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6c5c2d1f-3262-42d7-9b17-1781ed6c616f tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:48.491091 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6c5c2d1f-3262-42d7-9b17-1781ed6c616f tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:48.689706 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6c5c2d1f-3262-42d7-9b17-1781ed6c616f tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:48.700890 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6c5c2d1f-3262-42d7-9b17-1781ed6c616f tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1452 microversion: 2.1 time: 0.226997 Aug 26 11:10:48.702878 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 353/728] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:10:48 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1452 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:10:48.823243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1614b943-65b0-466c-9a23-a4b65d393b00 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:48.824141 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-1614b943-65b0-466c-9a23-a4b65d393b00 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:48.842299 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1614b943-65b0-466c-9a23-a4b65d393b00 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:48.843827 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1614b943-65b0-466c-9a23-a4b65d393b00 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:48.844900 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1614b943-65b0-466c-9a23-a4b65d393b00 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:48.846421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1614b943-65b0-466c-9a23-a4b65d393b00 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:48.847637 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1614b943-65b0-466c-9a23-a4b65d393b00 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:48.848858 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1614b943-65b0-466c-9a23-a4b65d393b00 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:49.031809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1614b943-65b0-466c-9a23-a4b65d393b00 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:49.042697 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1614b943-65b0-466c-9a23-a4b65d393b00 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:49.044160 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1614b943-65b0-466c-9a23-a4b65d393b00 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:49.045416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1614b943-65b0-466c-9a23-a4b65d393b00 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1736 microversion: 2.20 time: 0.228834 Aug 26 11:10:49.046666 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 376/729] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:48 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:50.069098 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0d241b51-51d3-4f77-9816-6cd5c378ad28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:50.069720 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0d241b51-51d3-4f77-9816-6cd5c378ad28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:50.085193 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d241b51-51d3-4f77-9816-6cd5c378ad28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:50.086154 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d241b51-51d3-4f77-9816-6cd5c378ad28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:50.086841 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d241b51-51d3-4f77-9816-6cd5c378ad28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:50.087868 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d241b51-51d3-4f77-9816-6cd5c378ad28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:50.088389 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d241b51-51d3-4f77-9816-6cd5c378ad28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:50.089011 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d241b51-51d3-4f77-9816-6cd5c378ad28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:50.274907 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0d241b51-51d3-4f77-9816-6cd5c378ad28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:50.286343 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0d241b51-51d3-4f77-9816-6cd5c378ad28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:50.288233 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0d241b51-51d3-4f77-9816-6cd5c378ad28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:50.289657 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0d241b51-51d3-4f77-9816-6cd5c378ad28 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1736 microversion: 2.20 time: 0.224542 Aug 26 11:10:50.298623 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 354/730] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:50 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:51.072290 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-644179ba-a8cf-4048-9101-01eab15668a8 req-ed821db5-3239-4676-a0d6-120c0068ae1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5e7d29e-0b68-4fea-9855-e1250c542c1b", "tag": "3ad3e811-600f-48c6-90d1-8ccbd04adc1c"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:10:51.093948 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-644179ba-a8cf-4048-9101-01eab15668a8 req-ed821db5-3239-4676-a0d6-120c0068ae1a service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:51.094515 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-644179ba-a8cf-4048-9101-01eab15668a8 req-ed821db5-3239-4676-a0d6-120c0068ae1a service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:51.095134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-644179ba-a8cf-4048-9101-01eab15668a8 req-ed821db5-3239-4676-a0d6-120c0068ae1a service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:51.126629 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-644179ba-a8cf-4048-9101-01eab15668a8 req-ed821db5-3239-4676-a0d6-120c0068ae1a service nova] Creating event network-changed:3ad3e811-600f-48c6-90d1-8ccbd04adc1c for instance d5e7d29e-0b68-4fea-9855-e1250c542c1b on hv-cinder-85236 Aug 26 11:10:51.132282 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-644179ba-a8cf-4048-9101-01eab15668a8 req-ed821db5-3239-4676-a0d6-120c0068ae1a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063726 Aug 26 11:10:51.133701 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 377/731] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:10:51.314181 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9f466f19-e576-4936-bca4-6f2137aa1aca tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:51.314946 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9f466f19-e576-4936-bca4-6f2137aa1aca tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:51.333320 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f466f19-e576-4936-bca4-6f2137aa1aca tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:51.333964 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f466f19-e576-4936-bca4-6f2137aa1aca tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:51.334524 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f466f19-e576-4936-bca4-6f2137aa1aca tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:51.335303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f466f19-e576-4936-bca4-6f2137aa1aca tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:51.335771 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f466f19-e576-4936-bca4-6f2137aa1aca tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:51.336208 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f466f19-e576-4936-bca4-6f2137aa1aca tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:51.918399 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9f466f19-e576-4936-bca4-6f2137aa1aca tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:51.944537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9f466f19-e576-4936-bca4-6f2137aa1aca tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:51.946781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9f466f19-e576-4936-bca4-6f2137aa1aca tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:51.954590 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9f466f19-e576-4936-bca4-6f2137aa1aca tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1736 microversion: 2.20 time: 0.640020 Aug 26 11:10:51.955355 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 355/732] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:51 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1736 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:52.981876 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c228724c-ce13-48d5-a2b8-30c2a4f42d0e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:52.984172 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c228724c-ce13-48d5-a2b8-30c2a4f42d0e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:52.992273 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c228724c-ce13-48d5-a2b8-30c2a4f42d0e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:52.993121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c228724c-ce13-48d5-a2b8-30c2a4f42d0e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:52.994342 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c228724c-ce13-48d5-a2b8-30c2a4f42d0e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:52.995519 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c228724c-ce13-48d5-a2b8-30c2a4f42d0e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:52.996591 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c228724c-ce13-48d5-a2b8-30c2a4f42d0e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:52.997453 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c228724c-ce13-48d5-a2b8-30c2a4f42d0e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:53.201485 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c228724c-ce13-48d5-a2b8-30c2a4f42d0e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:53.216320 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c228724c-ce13-48d5-a2b8-30c2a4f42d0e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:53.218288 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c228724c-ce13-48d5-a2b8-30c2a4f42d0e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:53.219807 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c228724c-ce13-48d5-a2b8-30c2a4f42d0e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1736 microversion: 2.20 time: 0.244017 Aug 26 11:10:53.220722 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 378/733] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:52 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:54.249309 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6dd19494-b0ab-4420-a720-6c20cce78d70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:54.251289 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6dd19494-b0ab-4420-a720-6c20cce78d70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:54.264574 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6dd19494-b0ab-4420-a720-6c20cce78d70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:54.265346 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6dd19494-b0ab-4420-a720-6c20cce78d70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:54.265791 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6dd19494-b0ab-4420-a720-6c20cce78d70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:54.266540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6dd19494-b0ab-4420-a720-6c20cce78d70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:54.267196 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6dd19494-b0ab-4420-a720-6c20cce78d70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:54.267794 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6dd19494-b0ab-4420-a720-6c20cce78d70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:54.416658 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6dd19494-b0ab-4420-a720-6c20cce78d70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:54.426153 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6dd19494-b0ab-4420-a720-6c20cce78d70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:54.428148 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6dd19494-b0ab-4420-a720-6c20cce78d70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:54.429534 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6dd19494-b0ab-4420-a720-6c20cce78d70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1736 microversion: 2.20 time: 0.188284 Aug 26 11:10:54.433356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 356/734] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:54 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:55.457131 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-9b4a518e-ed4e-438a-ba99-861524e30f94 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:55.457778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9b4a518e-ed4e-438a-ba99-861524e30f94 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:55.464994 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b4a518e-ed4e-438a-ba99-861524e30f94 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:55.465502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b4a518e-ed4e-438a-ba99-861524e30f94 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:55.465957 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b4a518e-ed4e-438a-ba99-861524e30f94 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:55.466709 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b4a518e-ed4e-438a-ba99-861524e30f94 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:55.467798 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b4a518e-ed4e-438a-ba99-861524e30f94 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:55.468542 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b4a518e-ed4e-438a-ba99-861524e30f94 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:55.643366 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9b4a518e-ed4e-438a-ba99-861524e30f94 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:55.657155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9b4a518e-ed4e-438a-ba99-861524e30f94 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:55.660034 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9b4a518e-ed4e-438a-ba99-861524e30f94 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:55.662326 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-9b4a518e-ed4e-438a-ba99-861524e30f94 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1736 microversion: 2.20 time: 0.210322 Aug 26 11:10:55.663803 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 379/735] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:55 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:56.701857 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ffda4755-7fc6-47dc-a91c-5be7caf10105 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:56.702656 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ffda4755-7fc6-47dc-a91c-5be7caf10105 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:56.708980 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffda4755-7fc6-47dc-a91c-5be7caf10105 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:56.709468 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffda4755-7fc6-47dc-a91c-5be7caf10105 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:56.709903 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffda4755-7fc6-47dc-a91c-5be7caf10105 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:56.710635 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffda4755-7fc6-47dc-a91c-5be7caf10105 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:56.711087 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffda4755-7fc6-47dc-a91c-5be7caf10105 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:56.711509 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffda4755-7fc6-47dc-a91c-5be7caf10105 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:56.877731 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ffda4755-7fc6-47dc-a91c-5be7caf10105 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:56.886312 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ffda4755-7fc6-47dc-a91c-5be7caf10105 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:56.887771 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ffda4755-7fc6-47dc-a91c-5be7caf10105 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:56.888990 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ffda4755-7fc6-47dc-a91c-5be7caf10105 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1736 microversion: 2.20 time: 0.191427 Aug 26 11:10:56.890022 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 357/736] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:56 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:57.911439 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c99a6f4c-bd69-4afe-832c-4eb8336a0e5e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:57.912008 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c99a6f4c-bd69-4afe-832c-4eb8336a0e5e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:57.918527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c99a6f4c-bd69-4afe-832c-4eb8336a0e5e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:57.919013 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c99a6f4c-bd69-4afe-832c-4eb8336a0e5e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:57.919450 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c99a6f4c-bd69-4afe-832c-4eb8336a0e5e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:57.920738 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c99a6f4c-bd69-4afe-832c-4eb8336a0e5e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:57.921284 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c99a6f4c-bd69-4afe-832c-4eb8336a0e5e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:57.921706 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c99a6f4c-bd69-4afe-832c-4eb8336a0e5e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:58.060263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c99a6f4c-bd69-4afe-832c-4eb8336a0e5e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:58.069517 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c99a6f4c-bd69-4afe-832c-4eb8336a0e5e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:58.071094 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c99a6f4c-bd69-4afe-832c-4eb8336a0e5e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:58.072275 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c99a6f4c-bd69-4afe-832c-4eb8336a0e5e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1718 microversion: 2.20 time: 0.164847 Aug 26 11:10:58.072836 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 380/737] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:57 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1718 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:10:59.096755 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1e68799a-6fcf-4f55-a1b6-5b1ed2c44df3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:10:59.097367 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1e68799a-6fcf-4f55-a1b6-5b1ed2c44df3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:10:59.103821 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1e68799a-6fcf-4f55-a1b6-5b1ed2c44df3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:59.104305 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1e68799a-6fcf-4f55-a1b6-5b1ed2c44df3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:59.104742 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1e68799a-6fcf-4f55-a1b6-5b1ed2c44df3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:59.105534 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1e68799a-6fcf-4f55-a1b6-5b1ed2c44df3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:10:59.105885 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1e68799a-6fcf-4f55-a1b6-5b1ed2c44df3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:10:59.106345 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1e68799a-6fcf-4f55-a1b6-5b1ed2c44df3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:10:59.238880 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1e68799a-6fcf-4f55-a1b6-5b1ed2c44df3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:59.247532 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1e68799a-6fcf-4f55-a1b6-5b1ed2c44df3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:59.249622 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1e68799a-6fcf-4f55-a1b6-5b1ed2c44df3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:10:59.250850 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1e68799a-6fcf-4f55-a1b6-5b1ed2c44df3 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1718 microversion: 2.20 time: 0.158644 Aug 26 11:10:59.251410 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 358/738] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:10:59 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:11:00.212608 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-bdf935c6-3ebb-4590-b3c6-c6fc59037fc6 req-55ef6413-a700-446e-ba5a-84c7a7757581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3983ebc-9955-4f0c-9ffd-0107d1a22723", "name": "network-vif-unplugged", "status": "completed", "tag": "6d309e62-5a5f-4a29-b1a7-66190210585a"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:11:00.228157 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-bdf935c6-3ebb-4590-b3c6-c6fc59037fc6 req-55ef6413-a700-446e-ba5a-84c7a7757581 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:00.228929 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-bdf935c6-3ebb-4590-b3c6-c6fc59037fc6 req-55ef6413-a700-446e-ba5a-84c7a7757581 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:00.229361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-bdf935c6-3ebb-4590-b3c6-c6fc59037fc6 req-55ef6413-a700-446e-ba5a-84c7a7757581 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:00.243947 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.compute.server_external_events [req-bdf935c6-3ebb-4590-b3c6-c6fc59037fc6 req-55ef6413-a700-446e-ba5a-84c7a7757581 service nova] Unable to find a host for instance f3983ebc-9955-4f0c-9ffd-0107d1a22723. Dropping event network-vif-unplugged {{(pid=120605) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 26 11:11:00.244839 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-bdf935c6-3ebb-4590-b3c6-c6fc59037fc6 req-55ef6413-a700-446e-ba5a-84c7a7757581 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039240 Aug 26 11:11:00.245442 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 381/739] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 26 11:11:00.274464 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-91e65113-5eff-4913-b3c7-5cd2cfe71239 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:00.275119 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-91e65113-5eff-4913-b3c7-5cd2cfe71239 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:00.282355 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91e65113-5eff-4913-b3c7-5cd2cfe71239 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:00.283218 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91e65113-5eff-4913-b3c7-5cd2cfe71239 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:00.283533 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91e65113-5eff-4913-b3c7-5cd2cfe71239 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:00.284285 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91e65113-5eff-4913-b3c7-5cd2cfe71239 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:00.284815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91e65113-5eff-4913-b3c7-5cd2cfe71239 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:00.285157 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91e65113-5eff-4913-b3c7-5cd2cfe71239 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:00.424357 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-91e65113-5eff-4913-b3c7-5cd2cfe71239 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:00.432465 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-91e65113-5eff-4913-b3c7-5cd2cfe71239 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:00.433904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-91e65113-5eff-4913-b3c7-5cd2cfe71239 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:00.435080 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-91e65113-5eff-4913-b3c7-5cd2cfe71239 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1661 microversion: 2.20 time: 0.164710 Aug 26 11:11:00.435686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 359/740] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:00 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1661 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:11:00.458040 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1282d9dc-78e6-4ff0-8e1e-6fc3925eb155 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5374119-6046-421d-9f21-91df24e65723"}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:11:00.460321 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-1282d9dc-78e6-4ff0-8e1e-6fc3925eb155 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:00.466396 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1282d9dc-78e6-4ff0-8e1e-6fc3925eb155 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:00.466906 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1282d9dc-78e6-4ff0-8e1e-6fc3925eb155 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:00.467393 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1282d9dc-78e6-4ff0-8e1e-6fc3925eb155 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:00.468102 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1282d9dc-78e6-4ff0-8e1e-6fc3925eb155 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:00.468557 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1282d9dc-78e6-4ff0-8e1e-6fc3925eb155 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:00.468980 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1282d9dc-78e6-4ff0-8e1e-6fc3925eb155 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:00.786078 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1282d9dc-78e6-4ff0-8e1e-6fc3925eb155 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "POST /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.331945 Aug 26 11:11:00.786703 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 382/741] 10.222.0.40 () {62 vars in 1364 bytes} [Fri Aug 26 11:11:00 2022] POST /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723/os-volume_attachments => generated 188 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 11:11:00.932261 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e3f29bbd-1bfc-415b-a0cf-c461a5be2df9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:00.932788 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e3f29bbd-1bfc-415b-a0cf-c461a5be2df9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:00.938997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e3f29bbd-1bfc-415b-a0cf-c461a5be2df9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:00.939480 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e3f29bbd-1bfc-415b-a0cf-c461a5be2df9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:00.939920 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e3f29bbd-1bfc-415b-a0cf-c461a5be2df9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:00.940628 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e3f29bbd-1bfc-415b-a0cf-c461a5be2df9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:00.941078 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e3f29bbd-1bfc-415b-a0cf-c461a5be2df9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:00.941592 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e3f29bbd-1bfc-415b-a0cf-c461a5be2df9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:01.206246 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e3f29bbd-1bfc-415b-a0cf-c461a5be2df9 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723/os-volume_attachments/e5374119-6046-421d-9f21-91df24e65723" status: 202 len: 0 microversion: 2.20 time: 0.277808 Aug 26 11:11:01.206836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 360/742] 10.222.0.40 () {60 vars in 1457 bytes} [Fri Aug 26 11:11:00 2022] DELETE /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723/os-volume_attachments/e5374119-6046-421d-9f21-91df24e65723 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:11:01.270654 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-339b9339-ff4b-4e82-9ba8-e3954d4159c1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:11:01.271235 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-339b9339-ff4b-4e82-9ba8-e3954d4159c1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:01.277942 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-339b9339-ff4b-4e82-9ba8-e3954d4159c1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:01.278450 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-339b9339-ff4b-4e82-9ba8-e3954d4159c1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:01.278908 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-339b9339-ff4b-4e82-9ba8-e3954d4159c1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:01.280186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-339b9339-ff4b-4e82-9ba8-e3954d4159c1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:01.280635 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-339b9339-ff4b-4e82-9ba8-e3954d4159c1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:01.281231 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-339b9339-ff4b-4e82-9ba8-e3954d4159c1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:01.381194 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-339b9339-ff4b-4e82-9ba8-e3954d4159c1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120605) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 11:11:01.465791 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-339b9339-ff4b-4e82-9ba8-e3954d4159c1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "POST /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723/action" status: 202 len: 0 microversion: 2.20 time: 0.199085 Aug 26 11:11:01.466488 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 383/743] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Aug 26 11:11:01 2022] POST /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:11:01.476033 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e67547aa-b5e4-46e5-aea4-f87e3c59205f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:01.476624 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e67547aa-b5e4-46e5-aea4-f87e3c59205f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:01.479150 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:11:01.486114 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e67547aa-b5e4-46e5-aea4-f87e3c59205f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:01.486608 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e67547aa-b5e4-46e5-aea4-f87e3c59205f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:01.487046 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e67547aa-b5e4-46e5-aea4-f87e3c59205f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:01.487813 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e67547aa-b5e4-46e5-aea4-f87e3c59205f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:01.488268 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e67547aa-b5e4-46e5-aea4-f87e3c59205f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:01.488694 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e67547aa-b5e4-46e5-aea4-f87e3c59205f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:01.669019 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e67547aa-b5e4-46e5-aea4-f87e3c59205f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:01.678291 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e67547aa-b5e4-46e5-aea4-f87e3c59205f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:01.679748 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e67547aa-b5e4-46e5-aea4-f87e3c59205f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:01.680908 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e67547aa-b5e4-46e5-aea4-f87e3c59205f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1669 microversion: 2.20 time: 0.209337 Aug 26 11:11:01.681470 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 361/744] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:01 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1669 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:11:02.707302 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-cc49863e-2b8c-4ef3-8674-6bd910815eb5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:02.707877 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-cc49863e-2b8c-4ef3-8674-6bd910815eb5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:02.715392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cc49863e-2b8c-4ef3-8674-6bd910815eb5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:02.715893 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cc49863e-2b8c-4ef3-8674-6bd910815eb5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:02.716535 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cc49863e-2b8c-4ef3-8674-6bd910815eb5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:02.717482 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cc49863e-2b8c-4ef3-8674-6bd910815eb5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:02.717948 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cc49863e-2b8c-4ef3-8674-6bd910815eb5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:02.718403 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cc49863e-2b8c-4ef3-8674-6bd910815eb5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:02.870503 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-cc49863e-2b8c-4ef3-8674-6bd910815eb5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:02.885483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-cc49863e-2b8c-4ef3-8674-6bd910815eb5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:02.889871 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-cc49863e-2b8c-4ef3-8674-6bd910815eb5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:02.893748 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-cc49863e-2b8c-4ef3-8674-6bd910815eb5 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1727 microversion: 2.20 time: 0.192895 Aug 26 11:11:02.894425 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 384/745] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:02 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1727 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:11:03.921698 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8d366e32-dcfc-47c8-95d2-af493108a5eb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:03.922351 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8d366e32-dcfc-47c8-95d2-af493108a5eb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:03.930281 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d366e32-dcfc-47c8-95d2-af493108a5eb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:03.931283 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d366e32-dcfc-47c8-95d2-af493108a5eb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:03.932092 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d366e32-dcfc-47c8-95d2-af493108a5eb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:03.933235 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d366e32-dcfc-47c8-95d2-af493108a5eb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:03.934055 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d366e32-dcfc-47c8-95d2-af493108a5eb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:03.935418 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d366e32-dcfc-47c8-95d2-af493108a5eb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:04.081795 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8d366e32-dcfc-47c8-95d2-af493108a5eb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:04.084136 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:11:04.091652 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8d366e32-dcfc-47c8-95d2-af493108a5eb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:04.093765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8d366e32-dcfc-47c8-95d2-af493108a5eb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:04.094986 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8d366e32-dcfc-47c8-95d2-af493108a5eb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1727 microversion: 2.20 time: 0.178209 Aug 26 11:11:04.095567 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 362/746] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:03 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:11:05.119828 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-dbfedaff-a595-42c1-97b9-f5daa4bd63ea tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:05.120939 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-dbfedaff-a595-42c1-97b9-f5daa4bd63ea tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:05.128410 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dbfedaff-a595-42c1-97b9-f5daa4bd63ea tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:05.128897 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dbfedaff-a595-42c1-97b9-f5daa4bd63ea tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:05.129360 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dbfedaff-a595-42c1-97b9-f5daa4bd63ea tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:05.130190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dbfedaff-a595-42c1-97b9-f5daa4bd63ea tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:05.130759 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dbfedaff-a595-42c1-97b9-f5daa4bd63ea tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:05.131120 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dbfedaff-a595-42c1-97b9-f5daa4bd63ea tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:05.287745 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-dbfedaff-a595-42c1-97b9-f5daa4bd63ea tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:05.297931 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-dbfedaff-a595-42c1-97b9-f5daa4bd63ea tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:05.299634 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-dbfedaff-a595-42c1-97b9-f5daa4bd63ea tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:05.300820 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-dbfedaff-a595-42c1-97b9-f5daa4bd63ea tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1727 microversion: 2.20 time: 0.186723 Aug 26 11:11:05.301385 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 385/747] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:05 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:11:06.325905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-032ade5a-ab40-4b1c-be57-f99a74690587 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:06.325905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-032ade5a-ab40-4b1c-be57-f99a74690587 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:06.333791 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-032ade5a-ab40-4b1c-be57-f99a74690587 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:06.334305 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-032ade5a-ab40-4b1c-be57-f99a74690587 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:06.334741 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-032ade5a-ab40-4b1c-be57-f99a74690587 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:06.335445 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-032ade5a-ab40-4b1c-be57-f99a74690587 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:06.335967 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-032ade5a-ab40-4b1c-be57-f99a74690587 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:06.336428 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-032ade5a-ab40-4b1c-be57-f99a74690587 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:06.485722 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-032ade5a-ab40-4b1c-be57-f99a74690587 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:06.494253 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-032ade5a-ab40-4b1c-be57-f99a74690587 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:06.495703 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-032ade5a-ab40-4b1c-be57-f99a74690587 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:06.497146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-032ade5a-ab40-4b1c-be57-f99a74690587 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1727 microversion: 2.20 time: 0.176933 Aug 26 11:11:06.497699 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 363/748] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:06 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:11:07.520808 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c735b906-91e9-480c-a1e7-877b89e520fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:07.521867 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c735b906-91e9-480c-a1e7-877b89e520fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:07.528943 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c735b906-91e9-480c-a1e7-877b89e520fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:07.530263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c735b906-91e9-480c-a1e7-877b89e520fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:07.530764 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c735b906-91e9-480c-a1e7-877b89e520fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:07.532068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c735b906-91e9-480c-a1e7-877b89e520fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:07.532811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c735b906-91e9-480c-a1e7-877b89e520fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:07.533253 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c735b906-91e9-480c-a1e7-877b89e520fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:07.692896 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c735b906-91e9-480c-a1e7-877b89e520fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:07.701524 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c735b906-91e9-480c-a1e7-877b89e520fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:07.703331 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c735b906-91e9-480c-a1e7-877b89e520fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:07.704552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c735b906-91e9-480c-a1e7-877b89e520fb tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1727 microversion: 2.20 time: 0.187770 Aug 26 11:11:07.705134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 386/749] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:07 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:11:08.728834 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-52165635-1fd4-43be-8d72-79380b7b38b1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:08.729462 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-52165635-1fd4-43be-8d72-79380b7b38b1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:08.737116 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52165635-1fd4-43be-8d72-79380b7b38b1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:08.737603 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52165635-1fd4-43be-8d72-79380b7b38b1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:08.738072 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52165635-1fd4-43be-8d72-79380b7b38b1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:08.738780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52165635-1fd4-43be-8d72-79380b7b38b1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:08.739230 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52165635-1fd4-43be-8d72-79380b7b38b1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:08.739645 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52165635-1fd4-43be-8d72-79380b7b38b1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:08.909743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-52165635-1fd4-43be-8d72-79380b7b38b1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:08.918160 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-52165635-1fd4-43be-8d72-79380b7b38b1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:08.919592 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-52165635-1fd4-43be-8d72-79380b7b38b1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:08.922075 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-52165635-1fd4-43be-8d72-79380b7b38b1 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1727 microversion: 2.20 time: 0.197393 Aug 26 11:11:08.922844 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 364/750] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:08 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:11:09.948810 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4825caec-2a85-4661-88eb-a9e5a0e69a1f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:09.949572 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4825caec-2a85-4661-88eb-a9e5a0e69a1f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:09.952786 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:11:09.961848 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4825caec-2a85-4661-88eb-a9e5a0e69a1f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:09.962366 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4825caec-2a85-4661-88eb-a9e5a0e69a1f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:09.962797 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4825caec-2a85-4661-88eb-a9e5a0e69a1f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:09.963523 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4825caec-2a85-4661-88eb-a9e5a0e69a1f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:09.963973 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4825caec-2a85-4661-88eb-a9e5a0e69a1f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:09.964543 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4825caec-2a85-4661-88eb-a9e5a0e69a1f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:10.138560 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4825caec-2a85-4661-88eb-a9e5a0e69a1f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:10.149707 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4825caec-2a85-4661-88eb-a9e5a0e69a1f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:10.151289 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4825caec-2a85-4661-88eb-a9e5a0e69a1f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:10.152672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4825caec-2a85-4661-88eb-a9e5a0e69a1f tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1727 microversion: 2.20 time: 0.208139 Aug 26 11:11:10.153546 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 387/751] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:09 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1727 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:11:11.180459 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a02b90d3-1f99-49e2-849a-1df0399450f2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:11.181088 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a02b90d3-1f99-49e2-849a-1df0399450f2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:11.188780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a02b90d3-1f99-49e2-849a-1df0399450f2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:11.189274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a02b90d3-1f99-49e2-849a-1df0399450f2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:11.189707 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a02b90d3-1f99-49e2-849a-1df0399450f2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:11.190430 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a02b90d3-1f99-49e2-849a-1df0399450f2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:11.190877 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a02b90d3-1f99-49e2-849a-1df0399450f2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:11.191313 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a02b90d3-1f99-49e2-849a-1df0399450f2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:11.333952 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a02b90d3-1f99-49e2-849a-1df0399450f2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:11.346222 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a02b90d3-1f99-49e2-849a-1df0399450f2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:11.347873 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a02b90d3-1f99-49e2-849a-1df0399450f2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:11.349176 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a02b90d3-1f99-49e2-849a-1df0399450f2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1727 microversion: 2.20 time: 0.172601 Aug 26 11:11:11.349730 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 365/752] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:11 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:11:12.375629 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0f802dd6-57a9-4e5e-9bf7-79ed7f8aee95 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:12.377573 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0f802dd6-57a9-4e5e-9bf7-79ed7f8aee95 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:12.385933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f802dd6-57a9-4e5e-9bf7-79ed7f8aee95 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:12.386677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f802dd6-57a9-4e5e-9bf7-79ed7f8aee95 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:12.387267 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f802dd6-57a9-4e5e-9bf7-79ed7f8aee95 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:12.388135 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f802dd6-57a9-4e5e-9bf7-79ed7f8aee95 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:12.388745 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f802dd6-57a9-4e5e-9bf7-79ed7f8aee95 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:12.389592 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0f802dd6-57a9-4e5e-9bf7-79ed7f8aee95 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:12.580956 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0f802dd6-57a9-4e5e-9bf7-79ed7f8aee95 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:12.586769 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:11:12.598178 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0f802dd6-57a9-4e5e-9bf7-79ed7f8aee95 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:12.600737 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-0f802dd6-57a9-4e5e-9bf7-79ed7f8aee95 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:12.602655 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0f802dd6-57a9-4e5e-9bf7-79ed7f8aee95 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1727 microversion: 2.20 time: 0.233367 Aug 26 11:11:12.611973 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 388/753] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:12 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1727 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 11:11:13.645124 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9e0a0c78-7851-44c4-bfc1-e354bd9c5e05 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:13.646126 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9e0a0c78-7851-44c4-bfc1-e354bd9c5e05 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:13.656977 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e0a0c78-7851-44c4-bfc1-e354bd9c5e05 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:13.657814 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e0a0c78-7851-44c4-bfc1-e354bd9c5e05 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:13.658596 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e0a0c78-7851-44c4-bfc1-e354bd9c5e05 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:13.663348 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e0a0c78-7851-44c4-bfc1-e354bd9c5e05 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:13.670366 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e0a0c78-7851-44c4-bfc1-e354bd9c5e05 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:13.671783 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e0a0c78-7851-44c4-bfc1-e354bd9c5e05 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:13.858080 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4c542fe7-9857-445b-994e-b062a9f8cc1b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:13.865871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9e0a0c78-7851-44c4-bfc1-e354bd9c5e05 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:13.866337 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4c542fe7-9857-445b-994e-b062a9f8cc1b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:13.869811 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9e0a0c78-7851-44c4-bfc1-e354bd9c5e05 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:13.871434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9e0a0c78-7851-44c4-bfc1-e354bd9c5e05 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:13.872617 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4c542fe7-9857-445b-994e-b062a9f8cc1b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:13.873673 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4c542fe7-9857-445b-994e-b062a9f8cc1b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:13.873934 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9e0a0c78-7851-44c4-bfc1-e354bd9c5e05 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1727 microversion: 2.20 time: 0.243085 Aug 26 11:11:13.874232 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4c542fe7-9857-445b-994e-b062a9f8cc1b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:13.874969 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 366/754] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:13 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1727 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:11:13.875169 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4c542fe7-9857-445b-994e-b062a9f8cc1b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:13.875344 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4c542fe7-9857-445b-994e-b062a9f8cc1b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:13.875811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4c542fe7-9857-445b-994e-b062a9f8cc1b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:13.906128 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4c542fe7-9857-445b-994e-b062a9f8cc1b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62/ips" status: 200 len: 149 microversion: 2.1 time: 0.055344 Aug 26 11:11:13.906705 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 389/755] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 11:11:13 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62/ips => generated 149 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:11:14.900320 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7ee8c471-0e8f-4f5a-bab5-a57024fd1288 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:14.900980 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7ee8c471-0e8f-4f5a-bab5-a57024fd1288 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:14.910487 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7ee8c471-0e8f-4f5a-bab5-a57024fd1288 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:14.910487 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7ee8c471-0e8f-4f5a-bab5-a57024fd1288 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:14.910487 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7ee8c471-0e8f-4f5a-bab5-a57024fd1288 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:14.910487 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7ee8c471-0e8f-4f5a-bab5-a57024fd1288 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:14.911178 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7ee8c471-0e8f-4f5a-bab5-a57024fd1288 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:14.911178 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7ee8c471-0e8f-4f5a-bab5-a57024fd1288 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:15.060236 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7ee8c471-0e8f-4f5a-bab5-a57024fd1288 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:15.073111 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7ee8c471-0e8f-4f5a-bab5-a57024fd1288 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:15.074690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7ee8c471-0e8f-4f5a-bab5-a57024fd1288 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:15.075867 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7ee8c471-0e8f-4f5a-bab5-a57024fd1288 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1727 microversion: 2.20 time: 0.179459 Aug 26 11:11:15.076664 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 367/756] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:14 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:11:15.299186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1adab44c-c3d3-4599-b378-82df51ff12d1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58ff6b79-bce6-4cfa-bf00-f43699bc1d4b"}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:11:15.302477 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-1adab44c-c3d3-4599-b378-82df51ff12d1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:15.311894 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1adab44c-c3d3-4599-b378-82df51ff12d1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:15.312772 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1adab44c-c3d3-4599-b378-82df51ff12d1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:15.313583 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1adab44c-c3d3-4599-b378-82df51ff12d1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:15.314890 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1adab44c-c3d3-4599-b378-82df51ff12d1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:15.315409 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1adab44c-c3d3-4599-b378-82df51ff12d1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:15.315842 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1adab44c-c3d3-4599-b378-82df51ff12d1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:15.584829 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1adab44c-c3d3-4599-b378-82df51ff12d1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "POST /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290197 Aug 26 11:11:15.585833 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 390/757] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 11:11:15 2022] POST /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:11:16.098971 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4214a82f-206f-4900-9412-d49efb9510e6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:16.099584 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4214a82f-206f-4900-9412-d49efb9510e6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:16.106278 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4214a82f-206f-4900-9412-d49efb9510e6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:16.107101 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4214a82f-206f-4900-9412-d49efb9510e6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:16.107211 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4214a82f-206f-4900-9412-d49efb9510e6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:16.108726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4214a82f-206f-4900-9412-d49efb9510e6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:16.109274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4214a82f-206f-4900-9412-d49efb9510e6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:16.109697 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4214a82f-206f-4900-9412-d49efb9510e6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:16.245442 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4214a82f-206f-4900-9412-d49efb9510e6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:16.255397 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4214a82f-206f-4900-9412-d49efb9510e6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:16.257088 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4214a82f-206f-4900-9412-d49efb9510e6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:16.258332 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4214a82f-206f-4900-9412-d49efb9510e6 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1727 microversion: 2.20 time: 0.163226 Aug 26 11:11:16.258909 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 368/758] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:16 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:11:17.281787 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-eafa977f-9744-416d-ac3e-e5f22604cb14 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:17.282544 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-eafa977f-9744-416d-ac3e-e5f22604cb14 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:17.288794 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-eafa977f-9744-416d-ac3e-e5f22604cb14 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:17.289261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-eafa977f-9744-416d-ac3e-e5f22604cb14 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:17.289700 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-eafa977f-9744-416d-ac3e-e5f22604cb14 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:17.290436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-eafa977f-9744-416d-ac3e-e5f22604cb14 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:17.290894 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-eafa977f-9744-416d-ac3e-e5f22604cb14 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:17.291321 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-eafa977f-9744-416d-ac3e-e5f22604cb14 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:17.427430 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-eafa977f-9744-416d-ac3e-e5f22604cb14 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:17.436240 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-eafa977f-9744-416d-ac3e-e5f22604cb14 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:17.437708 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-eafa977f-9744-416d-ac3e-e5f22604cb14 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:17.438977 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-eafa977f-9744-416d-ac3e-e5f22604cb14 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1727 microversion: 2.20 time: 0.161988 Aug 26 11:11:17.439545 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 391/759] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:17 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:11:18.286407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-9ec8a7b0-b317-41be-bba3-72f308f80105 req-fff0ab4d-f009-45dd-a401-67cb0550b3db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3983ebc-9955-4f0c-9ffd-0107d1a22723", "name": "network-vif-plugged", "status": "completed", "tag": "6d309e62-5a5f-4a29-b1a7-66190210585a"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:11:18.296994 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-9ec8a7b0-b317-41be-bba3-72f308f80105 req-fff0ab4d-f009-45dd-a401-67cb0550b3db service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:18.297476 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-9ec8a7b0-b317-41be-bba3-72f308f80105 req-fff0ab4d-f009-45dd-a401-67cb0550b3db service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:18.297900 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-9ec8a7b0-b317-41be-bba3-72f308f80105 req-fff0ab4d-f009-45dd-a401-67cb0550b3db service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:18.310116 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-9ec8a7b0-b317-41be-bba3-72f308f80105 req-fff0ab4d-f009-45dd-a401-67cb0550b3db service nova] Creating event network-vif-plugged:6d309e62-5a5f-4a29-b1a7-66190210585a for instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 on hv-cinder-85236 Aug 26 11:11:18.315173 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-9ec8a7b0-b317-41be-bba3-72f308f80105 req-fff0ab4d-f009-45dd-a401-67cb0550b3db service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032356 Aug 26 11:11:18.315785 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 369/760] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:11:18.461735 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-335f2bb3-f7b2-4a16-9139-c66583b433cc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:18.462643 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-335f2bb3-f7b2-4a16-9139-c66583b433cc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:18.469517 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-335f2bb3-f7b2-4a16-9139-c66583b433cc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:18.470016 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-335f2bb3-f7b2-4a16-9139-c66583b433cc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:18.470773 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-335f2bb3-f7b2-4a16-9139-c66583b433cc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:18.471470 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-335f2bb3-f7b2-4a16-9139-c66583b433cc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:18.471924 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-335f2bb3-f7b2-4a16-9139-c66583b433cc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:18.472346 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-335f2bb3-f7b2-4a16-9139-c66583b433cc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:18.668767 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-335f2bb3-f7b2-4a16-9139-c66583b433cc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:18.677129 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-335f2bb3-f7b2-4a16-9139-c66583b433cc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:18.678666 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-335f2bb3-f7b2-4a16-9139-c66583b433cc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:18.679838 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-335f2bb3-f7b2-4a16-9139-c66583b433cc tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1727 microversion: 2.20 time: 0.222182 Aug 26 11:11:18.680398 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 392/761] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:18 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1727 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:11:19.271569 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8c5d551d-c626-4be8-8cd8-be952c8068a4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:19.272180 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8c5d551d-c626-4be8-8cd8-be952c8068a4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:19.278630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c5d551d-c626-4be8-8cd8-be952c8068a4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:19.279183 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c5d551d-c626-4be8-8cd8-be952c8068a4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:19.279630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c5d551d-c626-4be8-8cd8-be952c8068a4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:19.280505 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c5d551d-c626-4be8-8cd8-be952c8068a4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:19.280967 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c5d551d-c626-4be8-8cd8-be952c8068a4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:19.281389 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c5d551d-c626-4be8-8cd8-be952c8068a4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:19.306713 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8c5d551d-c626-4be8-8cd8-be952c8068a4 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/ips" status: 200 len: 146 microversion: 2.1 time: 0.040090 Aug 26 11:11:19.307453 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 370/762] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 11:11:19 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:11:19.703756 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-929fed3c-35f9-4d63-b30e-235ecfb81a59 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:19.704371 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-929fed3c-35f9-4d63-b30e-235ecfb81a59 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:19.711115 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-929fed3c-35f9-4d63-b30e-235ecfb81a59 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:19.711605 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-929fed3c-35f9-4d63-b30e-235ecfb81a59 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:19.712041 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-929fed3c-35f9-4d63-b30e-235ecfb81a59 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:19.712751 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-929fed3c-35f9-4d63-b30e-235ecfb81a59 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:19.713202 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-929fed3c-35f9-4d63-b30e-235ecfb81a59 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:19.713623 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-929fed3c-35f9-4d63-b30e-235ecfb81a59 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:19.869205 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-929fed3c-35f9-4d63-b30e-235ecfb81a59 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:19.879635 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-929fed3c-35f9-4d63-b30e-235ecfb81a59 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:19.881161 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-929fed3c-35f9-4d63-b30e-235ecfb81a59 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:19.882397 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-929fed3c-35f9-4d63-b30e-235ecfb81a59 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1727 microversion: 2.20 time: 0.183005 Aug 26 11:11:19.882973 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 393/763] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:19 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:11:20.677003 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4e15b43b-6acd-4248-899c-1a057f885067 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d819f27d-0c91-4b3d-bd76-7d8d0f242854"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:11:20.679525 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4e15b43b-6acd-4248-899c-1a057f885067 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:20.686860 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e15b43b-6acd-4248-899c-1a057f885067 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:20.687362 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e15b43b-6acd-4248-899c-1a057f885067 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:20.687803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e15b43b-6acd-4248-899c-1a057f885067 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:20.688513 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e15b43b-6acd-4248-899c-1a057f885067 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:20.688974 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e15b43b-6acd-4248-899c-1a057f885067 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:20.689400 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e15b43b-6acd-4248-899c-1a057f885067 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:20.907431 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-8cb77b9d-90e4-43e0-8633-3d881ff9bd5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:20.908021 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-8cb77b9d-90e4-43e0-8633-3d881ff9bd5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:20.917486 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8cb77b9d-90e4-43e0-8633-3d881ff9bd5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:20.918061 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8cb77b9d-90e4-43e0-8633-3d881ff9bd5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:20.918726 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8cb77b9d-90e4-43e0-8633-3d881ff9bd5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:20.919630 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8cb77b9d-90e4-43e0-8633-3d881ff9bd5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:20.921137 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8cb77b9d-90e4-43e0-8633-3d881ff9bd5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:20.921746 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-8cb77b9d-90e4-43e0-8633-3d881ff9bd5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:20.977782 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4e15b43b-6acd-4248-899c-1a057f885067 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "POST /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304687 Aug 26 11:11:20.978508 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 371/764] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 11:11:20 2022] POST /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:11:21.127986 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8cb77b9d-90e4-43e0-8633-3d881ff9bd5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:21.136672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8cb77b9d-90e4-43e0-8633-3d881ff9bd5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:21.138268 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-8cb77b9d-90e4-43e0-8633-3d881ff9bd5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:21.139995 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-8cb77b9d-90e4-43e0-8633-3d881ff9bd5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1714 microversion: 2.20 time: 0.237301 Aug 26 11:11:21.140627 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 394/765] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:20 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1714 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:11:23.223113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f184af6b-0b6f-4582-85b2-b34e6080074f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Action: 'create', calling method: .version_select at 0x7f1a689c23a0>, body: {"keypair": {"name": "tempest-keypair-277066715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQlBnl6g7ngtGcSF7LMR94zAJUc0/Bmv76NfB/HxdXcaH8jo1Vn9JeK2AAOa9zq7EIWxi3MqxewJYc1q1x5q99xp3EfQwaWyCxcOgYZouce6hXrn9OqgMbovGr1bNuo4A=="}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:11:23.239616 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-f184af6b-0b6f-4582-85b2-b34e6080074f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Getting quotas for project f780402b93f94d26b2fceab83c0bf485. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:11:23.243569 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-f184af6b-0b6f-4582-85b2-b34e6080074f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Getting quotas for user 85716f53e88048af9a8fdcbe4415979c and project f780402b93f94d26b2fceab83c0bf485. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:11:23.268711 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f184af6b-0b6f-4582-85b2-b34e6080074f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050564 Aug 26 11:11:23.269307 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 372/766] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 11:11:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:11:24.947195 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-636402199", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad797925-a966-4b56-98aa-95c1629b07a2"}], "security_groups": [{"name": "tempest-securitygroup--1450641750"}], "key_name": "tempest-keypair-277066715", "user_data": "}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:11:25.053696 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.network.neutron [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] validate_networks() for [('ad797925-a966-4b56-98aa-95c1629b07a2', None, None, None, None, None)] {{(pid=120605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:11:25.447186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Flavor limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:11:25.447608 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Image limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:11:25.448082 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Flavor pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:11:25.448497 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Image pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:11:25.448922 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:11:25.459110 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:25.459592 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:25.460023 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:25.460750 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:25.461202 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:25.461622 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:25.479692 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Getting quotas for project f780402b93f94d26b2fceab83c0bf485. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:11:25.484098 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Getting quotas for user 85716f53e88048af9a8fdcbe4415979c and project f780402b93f94d26b2fceab83c0bf485. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:11:25.496044 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Going to run 1 instances... {{(pid=120605) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:11:25.499197 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:11:25.549192 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-61d2f016-7e54-4107-be4b-98ac8b2012eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.606273 Aug 26 11:11:25.554316 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 395/767] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:11:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:11:25.563788 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-28a68d3e-da00-40fd-8c18-53bc60432cd8 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:25.564635 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-28a68d3e-da00-40fd-8c18-53bc60432cd8 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:25.626528 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-28a68d3e-da00-40fd-8c18-53bc60432cd8 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:25.637416 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-28a68d3e-da00-40fd-8c18-53bc60432cd8 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 200 len: 1240 microversion: 2.1 time: 0.078372 Aug 26 11:11:25.639013 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 373/768] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:25 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:11:26.659670 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4b823d1c-0c93-4d31-aae9-7743b57c0321 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:26.660294 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4b823d1c-0c93-4d31-aae9-7743b57c0321 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:26.666680 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4b823d1c-0c93-4d31-aae9-7743b57c0321 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:26.667173 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4b823d1c-0c93-4d31-aae9-7743b57c0321 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:26.667707 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4b823d1c-0c93-4d31-aae9-7743b57c0321 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:26.668317 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4b823d1c-0c93-4d31-aae9-7743b57c0321 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:26.668775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4b823d1c-0c93-4d31-aae9-7743b57c0321 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:26.669201 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4b823d1c-0c93-4d31-aae9-7743b57c0321 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:26.737645 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4b823d1c-0c93-4d31-aae9-7743b57c0321 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:26.746256 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4b823d1c-0c93-4d31-aae9-7743b57c0321 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 200 len: 1292 microversion: 2.1 time: 0.090942 Aug 26 11:11:26.747114 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 396/769] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:26 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:11:27.769501 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-19a76e99-a276-47c2-b4b8-db0afa601dcd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:27.770140 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-19a76e99-a276-47c2-b4b8-db0afa601dcd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:27.777136 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-19a76e99-a276-47c2-b4b8-db0afa601dcd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:27.777627 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-19a76e99-a276-47c2-b4b8-db0afa601dcd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:27.778097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-19a76e99-a276-47c2-b4b8-db0afa601dcd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:27.778807 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-19a76e99-a276-47c2-b4b8-db0afa601dcd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:27.779358 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-19a76e99-a276-47c2-b4b8-db0afa601dcd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:27.780095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-19a76e99-a276-47c2-b4b8-db0afa601dcd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:27.957359 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-19a76e99-a276-47c2-b4b8-db0afa601dcd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:27.967079 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-19a76e99-a276-47c2-b4b8-db0afa601dcd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 200 len: 1366 microversion: 2.1 time: 0.201391 Aug 26 11:11:27.967939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 374/770] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:27 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:11:28.642350 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-dbae91fe-7144-4caa-9395-1eba1bbfd26b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:28.645169 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-dbae91fe-7144-4caa-9395-1eba1bbfd26b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:28.653645 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dbae91fe-7144-4caa-9395-1eba1bbfd26b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:28.654540 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dbae91fe-7144-4caa-9395-1eba1bbfd26b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:28.654948 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dbae91fe-7144-4caa-9395-1eba1bbfd26b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:28.655898 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dbae91fe-7144-4caa-9395-1eba1bbfd26b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:28.656575 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dbae91fe-7144-4caa-9395-1eba1bbfd26b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:28.657284 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-dbae91fe-7144-4caa-9395-1eba1bbfd26b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:28.699488 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-dbae91fe-7144-4caa-9395-1eba1bbfd26b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061097 Aug 26 11:11:28.704722 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 397/771] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:11:28 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:11:28.719414 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-93544d06-f9b1-4607-bdbc-4dc2adbbfe36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:28.719917 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-93544d06-f9b1-4607-bdbc-4dc2adbbfe36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:28.726211 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93544d06-f9b1-4607-bdbc-4dc2adbbfe36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:28.726581 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93544d06-f9b1-4607-bdbc-4dc2adbbfe36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:28.727020 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93544d06-f9b1-4607-bdbc-4dc2adbbfe36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:28.727738 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93544d06-f9b1-4607-bdbc-4dc2adbbfe36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:28.728178 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93544d06-f9b1-4607-bdbc-4dc2adbbfe36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:28.728806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93544d06-f9b1-4607-bdbc-4dc2adbbfe36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:28.774137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-93544d06-f9b1-4607-bdbc-4dc2adbbfe36 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments/d819f27d-0c91-4b3d-bd76-7d8d0f242854" status: 200 len: 194 microversion: 2.1 time: 0.064261 Aug 26 11:11:28.775121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 375/772] 10.222.0.40 () {58 vars in 1413 bytes} [Fri Aug 26 11:11:28 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments/d819f27d-0c91-4b3d-bd76-7d8d0f242854 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:11:28.858513 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-d672f463-d9a7-45ca-ad68-93181446a7c7 req-780fc530-68a8-4ceb-8014-26e2dfd7f562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84ff179-7a07-42bc-9fe4-689622b81ef1", "tag": "75d50641-5f7f-466e-8c43-62df59ab2567"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:11:28.872492 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-d672f463-d9a7-45ca-ad68-93181446a7c7 req-780fc530-68a8-4ceb-8014-26e2dfd7f562 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:28.874373 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-d672f463-d9a7-45ca-ad68-93181446a7c7 req-780fc530-68a8-4ceb-8014-26e2dfd7f562 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:28.875152 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-d672f463-d9a7-45ca-ad68-93181446a7c7 req-780fc530-68a8-4ceb-8014-26e2dfd7f562 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:28.889811 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-d672f463-d9a7-45ca-ad68-93181446a7c7 req-780fc530-68a8-4ceb-8014-26e2dfd7f562 service nova] Creating event network-changed:75d50641-5f7f-466e-8c43-62df59ab2567 for instance f84ff179-7a07-42bc-9fe4-689622b81ef1 on hv-cinder-85236 Aug 26 11:11:28.895226 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-d672f463-d9a7-45ca-ad68-93181446a7c7 req-780fc530-68a8-4ceb-8014-26e2dfd7f562 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044170 Aug 26 11:11:28.896896 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 398/773] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:11:28.991519 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5216c101-c5aa-481d-bdf2-65f545d528ac tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:28.992369 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5216c101-c5aa-481d-bdf2-65f545d528ac tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:29.001596 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5216c101-c5aa-481d-bdf2-65f545d528ac tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:29.002687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5216c101-c5aa-481d-bdf2-65f545d528ac tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:29.003434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5216c101-c5aa-481d-bdf2-65f545d528ac tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:29.004494 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5216c101-c5aa-481d-bdf2-65f545d528ac tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:29.005033 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5216c101-c5aa-481d-bdf2-65f545d528ac tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:29.005625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5216c101-c5aa-481d-bdf2-65f545d528ac tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:29.224484 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5216c101-c5aa-481d-bdf2-65f545d528ac tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:29.232676 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5216c101-c5aa-481d-bdf2-65f545d528ac tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 200 len: 1366 microversion: 2.1 time: 0.246498 Aug 26 11:11:29.233345 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 376/774] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:28 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:11:30.196492 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-644baa89-7544-4522-af05-7660feaf1475 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f00863f-3188-4852-97de-3ff4ef6d0bb3"}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:11:30.198933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-644baa89-7544-4522-af05-7660feaf1475 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:30.205412 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-644baa89-7544-4522-af05-7660feaf1475 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:30.205892 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-644baa89-7544-4522-af05-7660feaf1475 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:30.206356 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-644baa89-7544-4522-af05-7660feaf1475 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:30.207049 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-644baa89-7544-4522-af05-7660feaf1475 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:30.207495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-644baa89-7544-4522-af05-7660feaf1475 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:30.207905 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-644baa89-7544-4522-af05-7660feaf1475 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:30.253549 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d46646d1-5922-43fb-912a-f6c423775a7d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:30.254315 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d46646d1-5922-43fb-912a-f6c423775a7d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:30.261177 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d46646d1-5922-43fb-912a-f6c423775a7d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:30.261673 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d46646d1-5922-43fb-912a-f6c423775a7d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:30.262143 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d46646d1-5922-43fb-912a-f6c423775a7d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:30.263413 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d46646d1-5922-43fb-912a-f6c423775a7d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:30.263620 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d46646d1-5922-43fb-912a-f6c423775a7d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:30.263990 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d46646d1-5922-43fb-912a-f6c423775a7d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:30.432245 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d46646d1-5922-43fb-912a-f6c423775a7d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:30.440176 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d46646d1-5922-43fb-912a-f6c423775a7d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 200 len: 1366 microversion: 2.1 time: 0.190909 Aug 26 11:11:30.440940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 377/775] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:30 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:11:30.548363 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-644baa89-7544-4522-af05-7660feaf1475 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "POST /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356548 Aug 26 11:11:30.548978 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 399/776] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 11:11:30 2022] POST /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:11:31.462509 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-511f0a74-eddc-4403-a9c7-349cc352efa7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:31.463118 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-511f0a74-eddc-4403-a9c7-349cc352efa7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:31.470462 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-511f0a74-eddc-4403-a9c7-349cc352efa7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:31.470988 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-511f0a74-eddc-4403-a9c7-349cc352efa7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:31.471430 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-511f0a74-eddc-4403-a9c7-349cc352efa7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:31.472130 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-511f0a74-eddc-4403-a9c7-349cc352efa7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:31.472579 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-511f0a74-eddc-4403-a9c7-349cc352efa7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:31.473001 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-511f0a74-eddc-4403-a9c7-349cc352efa7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:31.610819 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-511f0a74-eddc-4403-a9c7-349cc352efa7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:31.618555 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-511f0a74-eddc-4403-a9c7-349cc352efa7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 200 len: 1366 microversion: 2.1 time: 0.159860 Aug 26 11:11:31.619122 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 378/777] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:31 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:11:32.646581 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-07d0542b-e476-463d-a1a3-ff80d94ca2b5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:32.648150 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-07d0542b-e476-463d-a1a3-ff80d94ca2b5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:32.655945 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-07d0542b-e476-463d-a1a3-ff80d94ca2b5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:32.656442 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-07d0542b-e476-463d-a1a3-ff80d94ca2b5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:32.656892 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-07d0542b-e476-463d-a1a3-ff80d94ca2b5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:32.657608 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-07d0542b-e476-463d-a1a3-ff80d94ca2b5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:32.658101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-07d0542b-e476-463d-a1a3-ff80d94ca2b5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:32.658538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-07d0542b-e476-463d-a1a3-ff80d94ca2b5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:32.816192 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-07d0542b-e476-463d-a1a3-ff80d94ca2b5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:32.824032 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-07d0542b-e476-463d-a1a3-ff80d94ca2b5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 200 len: 1366 microversion: 2.1 time: 0.186899 Aug 26 11:11:32.824674 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 400/778] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:32 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:11:33.846698 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2a19acde-c1c7-4568-bfb0-c136aa3e2f06 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:33.846698 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2a19acde-c1c7-4568-bfb0-c136aa3e2f06 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:33.848539 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:11:33.855066 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2a19acde-c1c7-4568-bfb0-c136aa3e2f06 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:33.855638 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2a19acde-c1c7-4568-bfb0-c136aa3e2f06 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:33.856155 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2a19acde-c1c7-4568-bfb0-c136aa3e2f06 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:33.856997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2a19acde-c1c7-4568-bfb0-c136aa3e2f06 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:33.857780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2a19acde-c1c7-4568-bfb0-c136aa3e2f06 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:33.858026 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2a19acde-c1c7-4568-bfb0-c136aa3e2f06 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:34.002144 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2a19acde-c1c7-4568-bfb0-c136aa3e2f06 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:34.010247 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2a19acde-c1c7-4568-bfb0-c136aa3e2f06 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 200 len: 1366 microversion: 2.1 time: 0.169465 Aug 26 11:11:34.010839 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 379/779] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:33 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:11:34.379049 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-196a2e9d-8e5b-4983-afae-12e1b4e541cf req-c08d4f1e-fed3-46a4-8812-9c42c29501ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84ff179-7a07-42bc-9fe4-689622b81ef1", "name": "network-vif-plugged", "status": "completed", "tag": "75d50641-5f7f-466e-8c43-62df59ab2567"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:11:34.390600 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-196a2e9d-8e5b-4983-afae-12e1b4e541cf req-c08d4f1e-fed3-46a4-8812-9c42c29501ac service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:34.391084 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-196a2e9d-8e5b-4983-afae-12e1b4e541cf req-c08d4f1e-fed3-46a4-8812-9c42c29501ac service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:34.391516 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-196a2e9d-8e5b-4983-afae-12e1b4e541cf req-c08d4f1e-fed3-46a4-8812-9c42c29501ac service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:34.404710 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-196a2e9d-8e5b-4983-afae-12e1b4e541cf req-c08d4f1e-fed3-46a4-8812-9c42c29501ac service nova] Creating event network-vif-plugged:75d50641-5f7f-466e-8c43-62df59ab2567 for instance f84ff179-7a07-42bc-9fe4-689622b81ef1 on hv-cinder-85236 Aug 26 11:11:34.410001 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-196a2e9d-8e5b-4983-afae-12e1b4e541cf req-c08d4f1e-fed3-46a4-8812-9c42c29501ac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034508 Aug 26 11:11:34.410919 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 401/780] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:11:35.032727 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2a459f7f-e70e-43f7-be15-2019efc86fd5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:35.033342 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2a459f7f-e70e-43f7-be15-2019efc86fd5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:35.039936 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2a459f7f-e70e-43f7-be15-2019efc86fd5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:35.040427 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2a459f7f-e70e-43f7-be15-2019efc86fd5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:35.040865 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2a459f7f-e70e-43f7-be15-2019efc86fd5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:35.041569 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2a459f7f-e70e-43f7-be15-2019efc86fd5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:35.042052 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2a459f7f-e70e-43f7-be15-2019efc86fd5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:35.042479 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2a459f7f-e70e-43f7-be15-2019efc86fd5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:35.183836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2a459f7f-e70e-43f7-be15-2019efc86fd5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:35.192066 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2a459f7f-e70e-43f7-be15-2019efc86fd5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 200 len: 1366 microversion: 2.1 time: 0.163886 Aug 26 11:11:35.192645 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 380/781] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:35 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:11:36.212046 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:11:36.212771 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=6 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:11:36.218364 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-35f5cff5-ba61-4abe-93ec-d8f131508b25 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:36.219400 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-35f5cff5-ba61-4abe-93ec-d8f131508b25 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:36.226761 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-35f5cff5-ba61-4abe-93ec-d8f131508b25 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:36.227259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-35f5cff5-ba61-4abe-93ec-d8f131508b25 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:36.227712 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-35f5cff5-ba61-4abe-93ec-d8f131508b25 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:36.228441 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-35f5cff5-ba61-4abe-93ec-d8f131508b25 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:36.228900 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-35f5cff5-ba61-4abe-93ec-d8f131508b25 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:36.229336 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-35f5cff5-ba61-4abe-93ec-d8f131508b25 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:36.376400 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-35f5cff5-ba61-4abe-93ec-d8f131508b25 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:36.384953 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-35f5cff5-ba61-4abe-93ec-d8f131508b25 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 200 len: 1366 microversion: 2.1 time: 0.174398 Aug 26 11:11:36.385560 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 402/782] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:36 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:11:37.411281 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a60a953a-9e14-4407-8788-52c68bf58a01 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:37.412162 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a60a953a-9e14-4407-8788-52c68bf58a01 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:37.415239 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=6 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:11:37.426648 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a60a953a-9e14-4407-8788-52c68bf58a01 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:37.427529 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a60a953a-9e14-4407-8788-52c68bf58a01 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:37.428335 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a60a953a-9e14-4407-8788-52c68bf58a01 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:37.429610 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a60a953a-9e14-4407-8788-52c68bf58a01 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:37.430466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a60a953a-9e14-4407-8788-52c68bf58a01 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:37.431273 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a60a953a-9e14-4407-8788-52c68bf58a01 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:37.440084 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:11:37.602472 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a60a953a-9e14-4407-8788-52c68bf58a01 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:37.614384 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a60a953a-9e14-4407-8788-52c68bf58a01 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 200 len: 1555 microversion: 2.1 time: 0.209034 Aug 26 11:11:37.614979 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 381/783] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:37 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:11:37.635496 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-ca44921e-95cd-426d-b709-b7344638c3a7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:37.636072 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-ca44921e-95cd-426d-b709-b7344638c3a7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:37.645641 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ca44921e-95cd-426d-b709-b7344638c3a7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:37.646295 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ca44921e-95cd-426d-b709-b7344638c3a7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:37.646809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ca44921e-95cd-426d-b709-b7344638c3a7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:37.647721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ca44921e-95cd-426d-b709-b7344638c3a7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:37.648191 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ca44921e-95cd-426d-b709-b7344638c3a7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:37.648619 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ca44921e-95cd-426d-b709-b7344638c3a7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:37.743228 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-ca44921e-95cd-426d-b709-b7344638c3a7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111532 Aug 26 11:11:37.744353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 403/784] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 26 11:11:37 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:11:38.167095 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e9e6717f-3626-455a-a0eb-63802debbf69 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:38.169416 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e9e6717f-3626-455a-a0eb-63802debbf69 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:38.176577 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9e6717f-3626-455a-a0eb-63802debbf69 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:38.177076 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9e6717f-3626-455a-a0eb-63802debbf69 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:38.177523 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9e6717f-3626-455a-a0eb-63802debbf69 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:38.178273 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9e6717f-3626-455a-a0eb-63802debbf69 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:38.178800 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9e6717f-3626-455a-a0eb-63802debbf69 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:38.179227 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9e6717f-3626-455a-a0eb-63802debbf69 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:38.212000 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e9e6717f-3626-455a-a0eb-63802debbf69 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048728 Aug 26 11:11:38.212451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 382/785] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:11:38 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:11:38.356502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-941b6d13-da53-408a-a00e-37f38e4f3b3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:38.357040 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-941b6d13-da53-408a-a00e-37f38e4f3b3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:38.365392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-941b6d13-da53-408a-a00e-37f38e4f3b3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:38.365884 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-941b6d13-da53-408a-a00e-37f38e4f3b3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:38.366360 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-941b6d13-da53-408a-a00e-37f38e4f3b3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:38.367105 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-941b6d13-da53-408a-a00e-37f38e4f3b3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:38.367565 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-941b6d13-da53-408a-a00e-37f38e4f3b3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:38.367988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-941b6d13-da53-408a-a00e-37f38e4f3b3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:38.401604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-941b6d13-da53-408a-a00e-37f38e4f3b3b tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments/d819f27d-0c91-4b3d-bd76-7d8d0f242854" status: 200 len: 194 microversion: 2.1 time: 0.049080 Aug 26 11:11:38.402268 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 404/786] 10.222.0.40 () {58 vars in 1413 bytes} [Fri Aug 26 11:11:38 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments/d819f27d-0c91-4b3d-bd76-7d8d0f242854 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:11:38.417153 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a2710dfa-2b33-4290-bdcc-533029ff2007 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:38.418005 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a2710dfa-2b33-4290-bdcc-533029ff2007 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:38.424664 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2710dfa-2b33-4290-bdcc-533029ff2007 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:38.425159 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2710dfa-2b33-4290-bdcc-533029ff2007 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:38.425832 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2710dfa-2b33-4290-bdcc-533029ff2007 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:38.426599 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2710dfa-2b33-4290-bdcc-533029ff2007 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:38.427061 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2710dfa-2b33-4290-bdcc-533029ff2007 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:38.427496 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2710dfa-2b33-4290-bdcc-533029ff2007 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:38.515378 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-a2710dfa-2b33-4290-bdcc-533029ff2007 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lazy-loading 'services' on Instance uuid 9ae0c083-f8fa-4180-87ab-44015a054859 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:11:38.605830 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a2710dfa-2b33-4290-bdcc-533029ff2007 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments/d819f27d-0c91-4b3d-bd76-7d8d0f242854" status: 202 len: 0 microversion: 2.1 time: 0.188390 Aug 26 11:11:38.605830 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 383/787] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 11:11:38 2022] DELETE /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments/d819f27d-0c91-4b3d-bd76-7d8d0f242854 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:11:38.821694 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-cb891114-184e-469c-acfb-9d3a5641acb9 req-3da4a558-9cbc-478d-9e00-2f5099fc0a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84ff179-7a07-42bc-9fe4-689622b81ef1", "tag": "75d50641-5f7f-466e-8c43-62df59ab2567"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:11:38.834023 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-cb891114-184e-469c-acfb-9d3a5641acb9 req-3da4a558-9cbc-478d-9e00-2f5099fc0a57 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:38.834518 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-cb891114-184e-469c-acfb-9d3a5641acb9 req-3da4a558-9cbc-478d-9e00-2f5099fc0a57 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:38.834945 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-cb891114-184e-469c-acfb-9d3a5641acb9 req-3da4a558-9cbc-478d-9e00-2f5099fc0a57 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:38.848474 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-cb891114-184e-469c-acfb-9d3a5641acb9 req-3da4a558-9cbc-478d-9e00-2f5099fc0a57 service nova] Creating event network-changed:75d50641-5f7f-466e-8c43-62df59ab2567 for instance f84ff179-7a07-42bc-9fe4-689622b81ef1 on hv-cinder-85236 Aug 26 11:11:38.853782 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-cb891114-184e-469c-acfb-9d3a5641acb9 req-3da4a558-9cbc-478d-9e00-2f5099fc0a57 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035607 Aug 26 11:11:38.854797 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 405/788] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:11:40.811509 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-76c7492e-8147-4066-8ce7-aacb69dc35f7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:40.812192 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-76c7492e-8147-4066-8ce7-aacb69dc35f7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:40.818619 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-76c7492e-8147-4066-8ce7-aacb69dc35f7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:40.819114 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-76c7492e-8147-4066-8ce7-aacb69dc35f7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:40.819558 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-76c7492e-8147-4066-8ce7-aacb69dc35f7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:40.820268 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-76c7492e-8147-4066-8ce7-aacb69dc35f7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:40.820725 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-76c7492e-8147-4066-8ce7-aacb69dc35f7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:40.821154 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-76c7492e-8147-4066-8ce7-aacb69dc35f7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:40.852027 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-76c7492e-8147-4066-8ce7-aacb69dc35f7 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments/6f00863f-3188-4852-97de-3ff4ef6d0bb3" status: 200 len: 194 microversion: 2.1 time: 0.046216 Aug 26 11:11:40.852628 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 384/789] 10.222.0.40 () {58 vars in 1413 bytes} [Fri Aug 26 11:11:40 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments/6f00863f-3188-4852-97de-3ff4ef6d0bb3 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:11:40.865854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f14b6054-85ec-4a67-b682-86dc965671ea tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:40.866803 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f14b6054-85ec-4a67-b682-86dc965671ea tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:40.869533 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:11:40.877565 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f14b6054-85ec-4a67-b682-86dc965671ea tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:40.878098 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f14b6054-85ec-4a67-b682-86dc965671ea tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:40.878832 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f14b6054-85ec-4a67-b682-86dc965671ea tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:40.879238 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f14b6054-85ec-4a67-b682-86dc965671ea tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:40.879689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f14b6054-85ec-4a67-b682-86dc965671ea tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:40.880113 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f14b6054-85ec-4a67-b682-86dc965671ea tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:40.885322 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:11:40.968555 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-f14b6054-85ec-4a67-b682-86dc965671ea tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lazy-loading 'services' on Instance uuid 9ae0c083-f8fa-4180-87ab-44015a054859 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:11:41.049831 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f14b6054-85ec-4a67-b682-86dc965671ea tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments/6f00863f-3188-4852-97de-3ff4ef6d0bb3" status: 202 len: 0 microversion: 2.1 time: 0.189328 Aug 26 11:11:41.050458 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 406/790] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 11:11:40 2022] DELETE /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments/6f00863f-3188-4852-97de-3ff4ef6d0bb3 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 11:11:42.227084 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-51c6fd59-5b16-4a8a-babe-04cc2d21bd57 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:42.228988 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-51c6fd59-5b16-4a8a-babe-04cc2d21bd57 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:42.236002 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-51c6fd59-5b16-4a8a-babe-04cc2d21bd57 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:42.236485 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-51c6fd59-5b16-4a8a-babe-04cc2d21bd57 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:42.236917 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-51c6fd59-5b16-4a8a-babe-04cc2d21bd57 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:42.237621 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-51c6fd59-5b16-4a8a-babe-04cc2d21bd57 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:42.238103 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-51c6fd59-5b16-4a8a-babe-04cc2d21bd57 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:42.238529 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-51c6fd59-5b16-4a8a-babe-04cc2d21bd57 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:42.269690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-51c6fd59-5b16-4a8a-babe-04cc2d21bd57 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047403 Aug 26 11:11:42.270366 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 385/791] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:11:42 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 11:11:42.387857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-cf0216c0-d97d-4c12-9dcb-3dab8074e5d8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:42.390795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-cf0216c0-d97d-4c12-9dcb-3dab8074e5d8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:42.397289 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf0216c0-d97d-4c12-9dcb-3dab8074e5d8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:42.397778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf0216c0-d97d-4c12-9dcb-3dab8074e5d8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:42.398251 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf0216c0-d97d-4c12-9dcb-3dab8074e5d8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:42.398949 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf0216c0-d97d-4c12-9dcb-3dab8074e5d8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:42.399399 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf0216c0-d97d-4c12-9dcb-3dab8074e5d8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:42.399821 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cf0216c0-d97d-4c12-9dcb-3dab8074e5d8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:42.430133 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-cf0216c0-d97d-4c12-9dcb-3dab8074e5d8 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046966 Aug 26 11:11:42.430695 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 407/792] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:11:42 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 11:11:42.492367 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3871a500-5f64-4fc2-b27c-14737a9270ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:42.492908 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3871a500-5f64-4fc2-b27c-14737a9270ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:42.500456 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3871a500-5f64-4fc2-b27c-14737a9270ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:42.500968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3871a500-5f64-4fc2-b27c-14737a9270ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:42.501405 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3871a500-5f64-4fc2-b27c-14737a9270ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:42.502125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3871a500-5f64-4fc2-b27c-14737a9270ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:42.502577 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3871a500-5f64-4fc2-b27c-14737a9270ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:42.502997 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3871a500-5f64-4fc2-b27c-14737a9270ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:42.528582 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3871a500-5f64-4fc2-b27c-14737a9270ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:11:42.608595 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3871a500-5f64-4fc2-b27c-14737a9270ba tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 204 len: 0 microversion: 2.1 time: 0.119519 Aug 26 11:11:42.609134 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 386/793] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:11:42 2022] DELETE /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:11:42.617600 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-9e0c674e-ef37-4270-bb73-bf8b271cbf91 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:42.618240 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9e0c674e-ef37-4270-bb73-bf8b271cbf91 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:42.625385 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9e0c674e-ef37-4270-bb73-bf8b271cbf91 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:42.625876 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9e0c674e-ef37-4270-bb73-bf8b271cbf91 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:42.626375 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9e0c674e-ef37-4270-bb73-bf8b271cbf91 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:42.627079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9e0c674e-ef37-4270-bb73-bf8b271cbf91 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:42.627533 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9e0c674e-ef37-4270-bb73-bf8b271cbf91 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:42.627961 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9e0c674e-ef37-4270-bb73-bf8b271cbf91 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:42.761898 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9e0c674e-ef37-4270-bb73-bf8b271cbf91 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:42.770331 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-9e0c674e-ef37-4270-bb73-bf8b271cbf91 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 200 len: 1673 microversion: 2.1 time: 0.156662 Aug 26 11:11:42.771176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 408/794] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:42 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:11:43.793192 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6bfc746b-69fe-48fc-8d36-30eb8c95f4b3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:43.793807 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6bfc746b-69fe-48fc-8d36-30eb8c95f4b3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:43.801426 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6bfc746b-69fe-48fc-8d36-30eb8c95f4b3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:43.802110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6bfc746b-69fe-48fc-8d36-30eb8c95f4b3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:43.802422 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6bfc746b-69fe-48fc-8d36-30eb8c95f4b3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:43.803204 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6bfc746b-69fe-48fc-8d36-30eb8c95f4b3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:43.803650 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6bfc746b-69fe-48fc-8d36-30eb8c95f4b3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:43.804070 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6bfc746b-69fe-48fc-8d36-30eb8c95f4b3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:43.941917 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6bfc746b-69fe-48fc-8d36-30eb8c95f4b3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:43.949584 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6bfc746b-69fe-48fc-8d36-30eb8c95f4b3 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 200 len: 1673 microversion: 2.1 time: 0.161181 Aug 26 11:11:43.950168 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 387/795] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:43 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:11:44.971905 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5a44de4c-2d90-48f8-99c6-a603a82e41d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:44.972550 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5a44de4c-2d90-48f8-99c6-a603a82e41d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:44.979237 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5a44de4c-2d90-48f8-99c6-a603a82e41d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:44.979726 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5a44de4c-2d90-48f8-99c6-a603a82e41d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:44.980157 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5a44de4c-2d90-48f8-99c6-a603a82e41d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:44.980862 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5a44de4c-2d90-48f8-99c6-a603a82e41d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:44.981313 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5a44de4c-2d90-48f8-99c6-a603a82e41d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:44.981728 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5a44de4c-2d90-48f8-99c6-a603a82e41d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:45.385225 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5a44de4c-2d90-48f8-99c6-a603a82e41d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:45.393639 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5a44de4c-2d90-48f8-99c6-a603a82e41d0 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 200 len: 1673 microversion: 2.1 time: 0.425742 Aug 26 11:11:45.394245 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 409/796] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:44 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 1673 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:11:45.871202 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-5ac2854a-e0c1-4df6-93ff-e028a1b90fff req-08f0ee48-6780-4552-8277-ab1ddf19824e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae0c083-f8fa-4180-87ab-44015a054859", "name": "network-vif-deleted", "tag": "85a81bb5-ae8a-48aa-a930-0b8c54a4bfba"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:11:45.886107 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-5ac2854a-e0c1-4df6-93ff-e028a1b90fff req-08f0ee48-6780-4552-8277-ab1ddf19824e service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:45.886719 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-5ac2854a-e0c1-4df6-93ff-e028a1b90fff req-08f0ee48-6780-4552-8277-ab1ddf19824e service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:45.887377 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-5ac2854a-e0c1-4df6-93ff-e028a1b90fff req-08f0ee48-6780-4552-8277-ab1ddf19824e service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:45.902995 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-5ac2854a-e0c1-4df6-93ff-e028a1b90fff req-08f0ee48-6780-4552-8277-ab1ddf19824e service nova] Creating event network-vif-deleted:85a81bb5-ae8a-48aa-a930-0b8c54a4bfba for instance 9ae0c083-f8fa-4180-87ab-44015a054859 on hv-cinder-85236 Aug 26 11:11:45.909589 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-5ac2854a-e0c1-4df6-93ff-e028a1b90fff req-08f0ee48-6780-4552-8277-ab1ddf19824e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053427 Aug 26 11:11:45.910472 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 388/797] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:11:46.415953 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-cd10b7d1-2c76-4234-87f5-3a5ce0bfda6f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:46.416552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-cd10b7d1-2c76-4234-87f5-3a5ce0bfda6f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:46.423757 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd10b7d1-2c76-4234-87f5-3a5ce0bfda6f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:46.424236 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd10b7d1-2c76-4234-87f5-3a5ce0bfda6f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:46.424667 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd10b7d1-2c76-4234-87f5-3a5ce0bfda6f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:46.425364 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd10b7d1-2c76-4234-87f5-3a5ce0bfda6f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:46.425809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd10b7d1-2c76-4234-87f5-3a5ce0bfda6f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:46.426248 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd10b7d1-2c76-4234-87f5-3a5ce0bfda6f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:46.459585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd10b7d1-2c76-4234-87f5-3a5ce0bfda6f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:46.460067 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd10b7d1-2c76-4234-87f5-3a5ce0bfda6f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:46.460687 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd10b7d1-2c76-4234-87f5-3a5ce0bfda6f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:46.461131 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-cd10b7d1-2c76-4234-87f5-3a5ce0bfda6f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lazy-loading 'fault' on Instance uuid 9ae0c083-f8fa-4180-87ab-44015a054859 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:11:46.504901 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-cd10b7d1-2c76-4234-87f5-3a5ce0bfda6f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '163e8be86d5640f88893c50e6f3a8af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa496929354424ca7d024a8279f2e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:46.512901 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-cd10b7d1-2c76-4234-87f5-3a5ce0bfda6f tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 200 len: 1327 microversion: 2.1 time: 0.100788 Aug 26 11:11:46.514035 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 410/798] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:46 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:11:47.548548 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1e67d059-b75a-4f92-b9bb-f13fa5526877 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:47.549242 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1e67d059-b75a-4f92-b9bb-f13fa5526877 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:47.555900 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1e67d059-b75a-4f92-b9bb-f13fa5526877 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:47.556381 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1e67d059-b75a-4f92-b9bb-f13fa5526877 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:47.556821 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1e67d059-b75a-4f92-b9bb-f13fa5526877 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:47.557553 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1e67d059-b75a-4f92-b9bb-f13fa5526877 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:47.558033 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1e67d059-b75a-4f92-b9bb-f13fa5526877 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:47.558460 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1e67d059-b75a-4f92-b9bb-f13fa5526877 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:47.575125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-1e67d059-b75a-4f92-b9bb-f13fa5526877 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] HTTP exception thrown: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1e67d059-b75a-4f92-b9bb-f13fa5526877 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Request method failure captured: Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 HTTP/1.1 Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKjSOVGVlQLgvqOBCGuVuE6J9AmctPA5-WT50KJmk6og7hyiznl58L4eU8USL9q9sW-6DMk-B97hwKkUunn2mFjj-1eokM38nOsF5zAegSTmYApQhyHblXoVhFqubFUocOCfiIb6dzpHEz_BeJyfMrAgLsVFLPCYh7I6bIrqbL_N33U Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: 0fa496929354424ca7d024a8279f2e80 Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:11:47.577483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:11:47.580018 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0fa496929354424ca7d024a8279f2e80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0fa496929354424ca7d024a8279f2e80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0fa496929354424ca7d024a8279f2e80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0fa496929354424ca7d024a8279f2e80"}]}] Aug 26 11:11:47.580018 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:11:47.580018 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 0fa496929354424ca7d024a8279f2e80 Aug 26 11:11:47.580018 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:11:47.580018 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeTestJSON-1686085778-project Aug 26 11:11:47.580018 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:11:47.580018 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:11:47.580018 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 163e8be86d5640f88893c50e6f3a8af7 Aug 26 11:11:47.580018 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeTestJSON-1686085778-project Aug 26 11:11:47.580018 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:11:47.580018 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. Aug 26 11:11:47.580018 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': '9ae0c083-f8fa-4180-87ab-44015a054859'} Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:11:47.581636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. Aug 26 11:11:47.584034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:11:47.586200 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1e67d059-b75a-4f92-b9bb-f13fa5526877 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Returning 404 to user: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:11:47.586200 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1e67d059-b75a-4f92-b9bb-f13fa5526877 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 404 len: 111 microversion: 2.1 time: 0.035321 Aug 26 11:11:47.586200 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 389/799] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:47 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 11:11:47.588091 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-7f318161-4a08-4398-be74-623cee8b3aa2 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '.version_select at 0x7f1a6886e3a0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:47.609245 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-7f318161-4a08-4398-be74-623cee8b3aa2 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-338274653" status: 202 len: 0 microversion: 2.1 time: 0.024901 Aug 26 11:11:47.609835 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 411/800] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 26 11:11:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-338274653 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:11:50.537525 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c8d82c00-b1a1-4339-ae25-e6c606faaa08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:50.538102 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c8d82c00-b1a1-4339-ae25-e6c606faaa08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:50.545090 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c8d82c00-b1a1-4339-ae25-e6c606faaa08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:50.545577 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c8d82c00-b1a1-4339-ae25-e6c606faaa08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:50.546041 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c8d82c00-b1a1-4339-ae25-e6c606faaa08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:50.546758 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c8d82c00-b1a1-4339-ae25-e6c606faaa08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:50.547212 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c8d82c00-b1a1-4339-ae25-e6c606faaa08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:50.547641 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c8d82c00-b1a1-4339-ae25-e6c606faaa08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:50.562263 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-c8d82c00-b1a1-4339-ae25-e6c606faaa08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] HTTP exception thrown: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c8d82c00-b1a1-4339-ae25-e6c606faaa08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Request method failure captured: Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: DELETE /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 HTTP/1.1 Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKjSOVGVlQLgvqOBCGuVuE6J9AmctPA5-WT50KJmk6og7hyiznl58L4eU8USL9q9sW-6DMk-B97hwKkUunn2mFjj-1eokM38nOsF5zAegSTmYApQhyHblXoVhFqubFUocOCfiIb6dzpHEz_BeJyfMrAgLsVFLPCYh7I6bIrqbL_N33U Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: 0fa496929354424ca7d024a8279f2e80 Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:11:50.563827 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:11:50.565324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0fa496929354424ca7d024a8279f2e80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0fa496929354424ca7d024a8279f2e80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0fa496929354424ca7d024a8279f2e80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0fa496929354424ca7d024a8279f2e80"}]}] Aug 26 11:11:50.565324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:11:50.565324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 0fa496929354424ca7d024a8279f2e80 Aug 26 11:11:50.565324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:11:50.565324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeTestJSON-1686085778-project Aug 26 11:11:50.565324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:11:50.565324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:11:50.565324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 163e8be86d5640f88893c50e6f3a8af7 Aug 26 11:11:50.565324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeTestJSON-1686085778-project Aug 26 11:11:50.565324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:11:50.565324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. Aug 26 11:11:50.565324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': '9ae0c083-f8fa-4180-87ab-44015a054859'} Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:11:50.566407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. Aug 26 11:11:50.567815 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:11:50.569358 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c8d82c00-b1a1-4339-ae25-e6c606faaa08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Returning 404 to user: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:11:50.569358 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c8d82c00-b1a1-4339-ae25-e6c606faaa08 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 404 len: 111 microversion: 2.1 time: 0.031680 Aug 26 11:11:50.569358 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 390/801] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:11:50 2022] DELETE /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:11:50.575143 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0bacbf2d-55f5-40de-8e72-b542c1760a6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:50.576328 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-0bacbf2d-55f5-40de-8e72-b542c1760a6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: 9ae0c083-f8fa-4180-87ab-44015a054859] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:50.742745 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0bacbf2d-55f5-40de-8e72-b542c1760a6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:50.743238 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0bacbf2d-55f5-40de-8e72-b542c1760a6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:50.743677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0bacbf2d-55f5-40de-8e72-b542c1760a6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:50.744395 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0bacbf2d-55f5-40de-8e72-b542c1760a6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:50.744857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0bacbf2d-55f5-40de-8e72-b542c1760a6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:50.745281 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-0bacbf2d-55f5-40de-8e72-b542c1760a6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:50.759984 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-0bacbf2d-55f5-40de-8e72-b542c1760a6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] HTTP exception thrown: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0bacbf2d-55f5-40de-8e72-b542c1760a6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Request method failure captured: Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 HTTP/1.1 Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKjSOVGVlQLgvqOBCGuVuE6J9AmctPA5-WT50KJmk6og7hyiznl58L4eU8USL9q9sW-6DMk-B97hwKkUunn2mFjj-1eokM38nOsF5zAegSTmYApQhyHblXoVhFqubFUocOCfiIb6dzpHEz_BeJyfMrAgLsVFLPCYh7I6bIrqbL_N33U Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: 0fa496929354424ca7d024a8279f2e80 Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:11:50.761571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:11:50.763616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0fa496929354424ca7d024a8279f2e80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0fa496929354424ca7d024a8279f2e80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0fa496929354424ca7d024a8279f2e80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0fa496929354424ca7d024a8279f2e80"}]}] Aug 26 11:11:50.763616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:11:50.763616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: 0fa496929354424ca7d024a8279f2e80 Aug 26 11:11:50.763616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:11:50.763616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-AttachVolumeTestJSON-1686085778-project Aug 26 11:11:50.763616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:11:50.763616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:11:50.763616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: 163e8be86d5640f88893c50e6f3a8af7 Aug 26 11:11:50.763616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-AttachVolumeTestJSON-1686085778-project Aug 26 11:11:50.763616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:11:50.763616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. Aug 26 11:11:50.763616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': '9ae0c083-f8fa-4180-87ab-44015a054859'} Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:11:50.764988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. Aug 26 11:11:50.766212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:11:50.767318 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0bacbf2d-55f5-40de-8e72-b542c1760a6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Returning 404 to user: Instance 9ae0c083-f8fa-4180-87ab-44015a054859 could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:11:50.767318 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0bacbf2d-55f5-40de-8e72-b542c1760a6d tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859" status: 404 len: 111 microversion: 2.1 time: 0.192566 Aug 26 11:11:50.767318 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 412/802] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:50 2022] GET /compute/v2.1/servers/9ae0c083-f8fa-4180-87ab-44015a054859 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:11:51.910141 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-49e13874-3e66-436a-aa15-984428d54937 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:51.910754 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-49e13874-3e66-436a-aa15-984428d54937 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:51.917212 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49e13874-3e66-436a-aa15-984428d54937 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:51.917698 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49e13874-3e66-436a-aa15-984428d54937 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:51.918216 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49e13874-3e66-436a-aa15-984428d54937 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:51.918888 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49e13874-3e66-436a-aa15-984428d54937 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:51.919396 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49e13874-3e66-436a-aa15-984428d54937 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:51.919935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49e13874-3e66-436a-aa15-984428d54937 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:51.934354 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-49e13874-3e66-436a-aa15-984428d54937 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] HTTP exception thrown: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-49e13874-3e66-436a-aa15-984428d54937 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Request method failure captured: Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: DELETE /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe HTTP/1.1 Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKjSOVGVlQLgvqOBCGuVuE6J9AmctPA5-WT50KJmk6og7hyiznl58L4eU8USL9q9sW-6DMk-B97hwKkUunn2mFjj-1eokM38nOsF5zAegSTmYApQhyHblXoVhFqubFUocOCfiIb6dzpHEz_BeJyfMrAgLsVFLPCYh7I6bIrqbL_N33U Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: 0fa496929354424ca7d024a8279f2e80 Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:11:51.936466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:11:51.938197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0fa496929354424ca7d024a8279f2e80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0fa496929354424ca7d024a8279f2e80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0fa496929354424ca7d024a8279f2e80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0fa496929354424ca7d024a8279f2e80"}]}] Aug 26 11:11:51.938197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:11:51.938197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 0fa496929354424ca7d024a8279f2e80 Aug 26 11:11:51.938197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:11:51.938197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeTestJSON-1686085778-project Aug 26 11:11:51.938197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:11:51.938197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:11:51.938197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 163e8be86d5640f88893c50e6f3a8af7 Aug 26 11:11:51.938197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeTestJSON-1686085778-project Aug 26 11:11:51.938197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:11:51.938197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. Aug 26 11:11:51.938197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'fcad555f-f60b-409e-9075-f4fcdbbba3fe'} Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:11:51.939099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. Aug 26 11:11:51.940611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:11:51.942270 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-49e13874-3e66-436a-aa15-984428d54937 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Returning 404 to user: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:11:51.942270 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-49e13874-3e66-436a-aa15-984428d54937 tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 404 len: 111 microversion: 2.1 time: 0.031702 Aug 26 11:11:51.942270 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 391/803] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:11:51 2022] DELETE /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:11:51.946485 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b1b3fd6d-a797-4a7b-9a97-03fed9c1fc1a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:51.947104 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b1b3fd6d-a797-4a7b-9a97-03fed9c1fc1a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] [instance: fcad555f-f60b-409e-9075-f4fcdbbba3fe] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:51.954387 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1b3fd6d-a797-4a7b-9a97-03fed9c1fc1a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:51.954883 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1b3fd6d-a797-4a7b-9a97-03fed9c1fc1a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:51.955329 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1b3fd6d-a797-4a7b-9a97-03fed9c1fc1a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:51.956039 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1b3fd6d-a797-4a7b-9a97-03fed9c1fc1a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:51.956496 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1b3fd6d-a797-4a7b-9a97-03fed9c1fc1a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:51.956925 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1b3fd6d-a797-4a7b-9a97-03fed9c1fc1a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:51.970933 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-b1b3fd6d-a797-4a7b-9a97-03fed9c1fc1a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] HTTP exception thrown: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b1b3fd6d-a797-4a7b-9a97-03fed9c1fc1a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Request method failure captured: Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe HTTP/1.1 Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKjSOVGVlQLgvqOBCGuVuE6J9AmctPA5-WT50KJmk6og7hyiznl58L4eU8USL9q9sW-6DMk-B97hwKkUunn2mFjj-1eokM38nOsF5zAegSTmYApQhyHblXoVhFqubFUocOCfiIb6dzpHEz_BeJyfMrAgLsVFLPCYh7I6bIrqbL_N33U Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: 0fa496929354424ca7d024a8279f2e80 Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:11:51.972493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:11:51.974154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0fa496929354424ca7d024a8279f2e80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0fa496929354424ca7d024a8279f2e80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0fa496929354424ca7d024a8279f2e80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0fa496929354424ca7d024a8279f2e80"}]}] Aug 26 11:11:51.974154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:11:51.974154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: 0fa496929354424ca7d024a8279f2e80 Aug 26 11:11:51.974154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1686085778 Aug 26 11:11:51.974154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-AttachVolumeTestJSON-1686085778-project Aug 26 11:11:51.974154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:11:51.974154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:11:51.974154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: 163e8be86d5640f88893c50e6f3a8af7 Aug 26 11:11:51.974154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-AttachVolumeTestJSON-1686085778-project Aug 26 11:11:51.974154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:11:51.974154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. Aug 26 11:11:51.974154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': 'fcad555f-f60b-409e-9075-f4fcdbbba3fe'} Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:11:51.975130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. Aug 26 11:11:51.976653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:11:51.978060 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b1b3fd6d-a797-4a7b-9a97-03fed9c1fc1a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] Returning 404 to user: Instance fcad555f-f60b-409e-9075-f4fcdbbba3fe could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:11:51.978060 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b1b3fd6d-a797-4a7b-9a97-03fed9c1fc1a tempest-AttachVolumeTestJSON-1686085778 tempest-AttachVolumeTestJSON-1686085778-project] 10.222.0.40 "GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe" status: 404 len: 111 microversion: 2.1 time: 0.031271 Aug 26 11:11:51.978060 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 413/804] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:11:51 2022] GET /compute/v2.1/servers/fcad555f-f60b-409e-9075-f4fcdbbba3fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:11:59.519366 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7918a75e-f696-4737-b78e-ef42f8055b79 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:59.521509 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7918a75e-f696-4737-b78e-ef42f8055b79 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:59.527876 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7918a75e-f696-4737-b78e-ef42f8055b79 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:59.528357 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7918a75e-f696-4737-b78e-ef42f8055b79 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:59.529538 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7918a75e-f696-4737-b78e-ef42f8055b79 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:59.530447 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7918a75e-f696-4737-b78e-ef42f8055b79 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:59.530923 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7918a75e-f696-4737-b78e-ef42f8055b79 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:59.531342 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7918a75e-f696-4737-b78e-ef42f8055b79 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:59.563995 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7918a75e-f696-4737-b78e-ef42f8055b79 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048564 Aug 26 11:11:59.564556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 392/805] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 26 11:11:59 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:11:59.629195 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c9f768fb-b6f9-40d6-b089-a108e1d941c2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:59.629769 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c9f768fb-b6f9-40d6-b089-a108e1d941c2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:59.636532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c9f768fb-b6f9-40d6-b089-a108e1d941c2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:59.637021 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c9f768fb-b6f9-40d6-b089-a108e1d941c2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:59.637458 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c9f768fb-b6f9-40d6-b089-a108e1d941c2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:59.638239 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c9f768fb-b6f9-40d6-b089-a108e1d941c2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:59.638697 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c9f768fb-b6f9-40d6-b089-a108e1d941c2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:59.639118 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c9f768fb-b6f9-40d6-b089-a108e1d941c2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:59.667585 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c9f768fb-b6f9-40d6-b089-a108e1d941c2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Going to try to terminate instance {{(pid=120605) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:11:59.762650 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c9f768fb-b6f9-40d6-b089-a108e1d941c2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 204 len: 0 microversion: 2.20 time: 0.136860 Aug 26 11:11:59.766104 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 414/806] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Aug 26 11:11:59 2022] DELETE /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 11:11:59.774515 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f726d335-2bcb-4f78-80ff-609dfd68258b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:11:59.775259 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f726d335-2bcb-4f78-80ff-609dfd68258b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:11:59.782593 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f726d335-2bcb-4f78-80ff-609dfd68258b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:59.783082 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f726d335-2bcb-4f78-80ff-609dfd68258b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:59.783520 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f726d335-2bcb-4f78-80ff-609dfd68258b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:59.784226 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f726d335-2bcb-4f78-80ff-609dfd68258b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:11:59.784671 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f726d335-2bcb-4f78-80ff-609dfd68258b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:11:59.785092 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f726d335-2bcb-4f78-80ff-609dfd68258b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:11:59.934764 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f726d335-2bcb-4f78-80ff-609dfd68258b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:59.943889 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f726d335-2bcb-4f78-80ff-609dfd68258b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:59.945447 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f726d335-2bcb-4f78-80ff-609dfd68258b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:11:59.946809 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f726d335-2bcb-4f78-80ff-609dfd68258b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.177433 Aug 26 11:11:59.947362 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 393/807] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:11:59 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:12:00.973809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-523be976-7ce4-4643-93ce-788aeb153f70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:00.974538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-523be976-7ce4-4643-93ce-788aeb153f70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:00.981023 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-523be976-7ce4-4643-93ce-788aeb153f70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:00.981532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-523be976-7ce4-4643-93ce-788aeb153f70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:00.982656 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-523be976-7ce4-4643-93ce-788aeb153f70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:00.983372 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-523be976-7ce4-4643-93ce-788aeb153f70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:00.983826 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-523be976-7ce4-4643-93ce-788aeb153f70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:00.984253 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-523be976-7ce4-4643-93ce-788aeb153f70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:01.122967 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-523be976-7ce4-4643-93ce-788aeb153f70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:01.132241 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-523be976-7ce4-4643-93ce-788aeb153f70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:01.133613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-523be976-7ce4-4643-93ce-788aeb153f70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:01.134827 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-523be976-7ce4-4643-93ce-788aeb153f70 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.165426 Aug 26 11:12:01.135464 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 415/808] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:12:00 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:12:02.158485 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-45ecc8d3-0b73-452f-a11e-27fbd035a3a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:02.159033 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-45ecc8d3-0b73-452f-a11e-27fbd035a3a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:02.165579 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45ecc8d3-0b73-452f-a11e-27fbd035a3a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:02.166086 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45ecc8d3-0b73-452f-a11e-27fbd035a3a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:02.166524 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45ecc8d3-0b73-452f-a11e-27fbd035a3a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:02.167210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45ecc8d3-0b73-452f-a11e-27fbd035a3a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:02.167654 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45ecc8d3-0b73-452f-a11e-27fbd035a3a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:02.168067 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45ecc8d3-0b73-452f-a11e-27fbd035a3a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:02.308592 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-45ecc8d3-0b73-452f-a11e-27fbd035a3a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:02.317506 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-45ecc8d3-0b73-452f-a11e-27fbd035a3a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:02.318973 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-45ecc8d3-0b73-452f-a11e-27fbd035a3a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:02.320129 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-45ecc8d3-0b73-452f-a11e-27fbd035a3a2 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.165633 Aug 26 11:12:02.320687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 394/809] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:12:02 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:12:03.343838 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-d2cdde42-0353-4eba-b838-389861e21653 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:03.345184 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-d2cdde42-0353-4eba-b838-389861e21653 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:03.351966 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d2cdde42-0353-4eba-b838-389861e21653 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:03.352570 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d2cdde42-0353-4eba-b838-389861e21653 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:03.353119 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d2cdde42-0353-4eba-b838-389861e21653 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:03.353828 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d2cdde42-0353-4eba-b838-389861e21653 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:03.354308 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d2cdde42-0353-4eba-b838-389861e21653 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:03.354729 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-d2cdde42-0353-4eba-b838-389861e21653 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:03.518530 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-d2cdde42-0353-4eba-b838-389861e21653 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:03.529571 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-d2cdde42-0353-4eba-b838-389861e21653 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:03.531113 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-d2cdde42-0353-4eba-b838-389861e21653 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:03.532340 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-d2cdde42-0353-4eba-b838-389861e21653 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1720 microversion: 2.20 time: 0.193931 Aug 26 11:12:03.532901 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 416/810] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:12:03 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1720 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:12:04.556766 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1a6b4532-64e0-4f4f-8a83-387bbbc29072 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:04.557559 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1a6b4532-64e0-4f4f-8a83-387bbbc29072 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:04.560204 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:12:04.565831 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a6b4532-64e0-4f4f-8a83-387bbbc29072 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:04.566420 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a6b4532-64e0-4f4f-8a83-387bbbc29072 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:04.566867 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a6b4532-64e0-4f4f-8a83-387bbbc29072 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:04.567578 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a6b4532-64e0-4f4f-8a83-387bbbc29072 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:04.568037 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a6b4532-64e0-4f4f-8a83-387bbbc29072 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:04.568468 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a6b4532-64e0-4f4f-8a83-387bbbc29072 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:04.639819 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1a6b4532-64e0-4f4f-8a83-387bbbc29072 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:04.651575 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1a6b4532-64e0-4f4f-8a83-387bbbc29072 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:04.653076 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1a6b4532-64e0-4f4f-8a83-387bbbc29072 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aedac3f62dd94f87b968f6c71d68a0a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78251e5bdb2548d1bb18aacd4ccbcd34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:04.655172 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1a6b4532-64e0-4f4f-8a83-387bbbc29072 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 200 len: 1652 microversion: 2.20 time: 0.102365 Aug 26 11:12:04.655989 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 395/811] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:12:04 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 1652 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 11:12:04.774089 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-281d478c-71b8-416f-aa70-cddcde16bfba req-c3346160-048a-418e-b364-b5680d98a276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3983ebc-9955-4f0c-9ffd-0107d1a22723", "name": "network-vif-deleted", "tag": "6d309e62-5a5f-4a29-b1a7-66190210585a"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:12:04.783463 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-281d478c-71b8-416f-aa70-cddcde16bfba req-c3346160-048a-418e-b364-b5680d98a276 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:04.783961 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-281d478c-71b8-416f-aa70-cddcde16bfba req-c3346160-048a-418e-b364-b5680d98a276 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:04.784387 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-281d478c-71b8-416f-aa70-cddcde16bfba req-c3346160-048a-418e-b364-b5680d98a276 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:04.796322 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-281d478c-71b8-416f-aa70-cddcde16bfba req-c3346160-048a-418e-b364-b5680d98a276 service nova] Creating event network-vif-deleted:6d309e62-5a5f-4a29-b1a7-66190210585a for instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 on hv-cinder-85236 Aug 26 11:12:04.803391 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-281d478c-71b8-416f-aa70-cddcde16bfba req-c3346160-048a-418e-b364-b5680d98a276 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034814 Aug 26 11:12:04.804020 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 417/812] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:12:05.677337 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7b4b9370-4177-4f3a-aaac-9d33b8c0a785 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:05.677948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7b4b9370-4177-4f3a-aaac-9d33b8c0a785 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:05.685310 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b4b9370-4177-4f3a-aaac-9d33b8c0a785 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:05.685805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b4b9370-4177-4f3a-aaac-9d33b8c0a785 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:05.686269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b4b9370-4177-4f3a-aaac-9d33b8c0a785 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:05.686972 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b4b9370-4177-4f3a-aaac-9d33b8c0a785 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:05.687417 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b4b9370-4177-4f3a-aaac-9d33b8c0a785 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:05.687841 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b4b9370-4177-4f3a-aaac-9d33b8c0a785 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:05.704503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-7b4b9370-4177-4f3a-aaac-9d33b8c0a785 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] HTTP exception thrown: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7b4b9370-4177-4f3a-aaac-9d33b8c0a785 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Request method failure captured: Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 HTTP/1.1 Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKjRFHZ44GBZQ9If55-jSqgIoqi-rUu1ZMNZQk7koc0ph8O9xqvn1jpC8ZiSpv_a9qksE9wcI2JQQd4dmhh3zEz8UgQLhcZIrDFSG2Yhl8EKXMMM9k7HHtx8ngoASi6GVqDPdkQv3P9K4jrssqzKmgH6zks9EftRTBsct3YJbErETcQ Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: 78251e5bdb2548d1bb18aacd4ccbcd34 Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:12:05.706110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:12:05.707781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78251e5bdb2548d1bb18aacd4ccbcd34"}]}] Aug 26 11:12:05.707781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:12:05.707781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 78251e5bdb2548d1bb18aacd4ccbcd34 Aug 26 11:12:05.707781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:12:05.707781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeShelveTestJSON-1222277151-project Aug 26 11:12:05.707781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:12:05.707781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:12:05.707781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: aedac3f62dd94f87b968f6c71d68a0a3 Aug 26 11:12:05.707781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1222277151-project Aug 26 11:12:05.707781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:12:05.707781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. Aug 26 11:12:05.707781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'f3983ebc-9955-4f0c-9ffd-0107d1a22723'} Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:12:05.708588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. Aug 26 11:12:05.709780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:05.710905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7b4b9370-4177-4f3a-aaac-9d33b8c0a785 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Returning 404 to user: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:12:05.710905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7b4b9370-4177-4f3a-aaac-9d33b8c0a785 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 404 len: 111 microversion: 2.20 time: 0.034184 Aug 26 11:12:05.710905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 396/813] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:12:05 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 11:12:05.717678 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-34ae7202-2584-45df-ad50-21f75b6f677e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '.version_select at 0x7f1a6886e4c0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:05.741673 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-34ae7202-2584-45df-ad50-21f75b6f677e tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-402353492" status: 204 len: 0 microversion: 2.20 time: 0.028437 Aug 26 11:12:05.742298 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 418/814] 10.222.0.40 () {60 vars in 1259 bytes} [Fri Aug 26 11:12:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-402353492 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 26 11:12:07.582508 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2ff19695-c1d9-4c77-92d8-ffdc09bc4433 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:07.583079 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2ff19695-c1d9-4c77-92d8-ffdc09bc4433 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:07.589119 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2ff19695-c1d9-4c77-92d8-ffdc09bc4433 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:07.589613 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2ff19695-c1d9-4c77-92d8-ffdc09bc4433 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:07.590247 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2ff19695-c1d9-4c77-92d8-ffdc09bc4433 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:07.591433 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2ff19695-c1d9-4c77-92d8-ffdc09bc4433 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:07.592014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2ff19695-c1d9-4c77-92d8-ffdc09bc4433 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:07.592451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2ff19695-c1d9-4c77-92d8-ffdc09bc4433 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:07.597040 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:12:07.608132 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-2ff19695-c1d9-4c77-92d8-ffdc09bc4433 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] HTTP exception thrown: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2ff19695-c1d9-4c77-92d8-ffdc09bc4433 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Request method failure captured: Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: DELETE /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 HTTP/1.1 Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKjRFHZ44GBZQ9If55-jSqgIoqi-rUu1ZMNZQk7koc0ph8O9xqvn1jpC8ZiSpv_a9qksE9wcI2JQQd4dmhh3zEz8UgQLhcZIrDFSG2Yhl8EKXMMM9k7HHtx8ngoASi6GVqDPdkQv3P9K4jrssqzKmgH6zks9EftRTBsct3YJbErETcQ Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: 78251e5bdb2548d1bb18aacd4ccbcd34 Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:12:07.609770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:12:07.611368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78251e5bdb2548d1bb18aacd4ccbcd34"}]}] Aug 26 11:12:07.611368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:12:07.611368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 78251e5bdb2548d1bb18aacd4ccbcd34 Aug 26 11:12:07.611368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:12:07.611368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeShelveTestJSON-1222277151-project Aug 26 11:12:07.611368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:12:07.611368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:12:07.611368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: aedac3f62dd94f87b968f6c71d68a0a3 Aug 26 11:12:07.611368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1222277151-project Aug 26 11:12:07.611368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:12:07.611368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. Aug 26 11:12:07.611368 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'f3983ebc-9955-4f0c-9ffd-0107d1a22723'} Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:12:07.612210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. Aug 26 11:12:07.614274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:07.615589 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2ff19695-c1d9-4c77-92d8-ffdc09bc4433 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Returning 404 to user: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:12:07.615589 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2ff19695-c1d9-4c77-92d8-ffdc09bc4433 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 404 len: 111 microversion: 2.20 time: 0.033934 Aug 26 11:12:07.615589 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 397/815] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Aug 26 11:12:07 2022] DELETE /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 11:12:07.621454 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-24f4969e-d747-4d5f-bfd8-d8645e7a2c02 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:07.622558 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-24f4969e-d747-4d5f-bfd8-d8645e7a2c02 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: f3983ebc-9955-4f0c-9ffd-0107d1a22723] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:07.630209 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-24f4969e-d747-4d5f-bfd8-d8645e7a2c02 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:07.630699 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-24f4969e-d747-4d5f-bfd8-d8645e7a2c02 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:07.631131 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-24f4969e-d747-4d5f-bfd8-d8645e7a2c02 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:07.631834 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-24f4969e-d747-4d5f-bfd8-d8645e7a2c02 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:07.632283 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-24f4969e-d747-4d5f-bfd8-d8645e7a2c02 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:07.632707 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-24f4969e-d747-4d5f-bfd8-d8645e7a2c02 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:07.650467 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-24f4969e-d747-4d5f-bfd8-d8645e7a2c02 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] HTTP exception thrown: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-24f4969e-d747-4d5f-bfd8-d8645e7a2c02 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Request method failure captured: Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 HTTP/1.1 Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKjRFHZ44GBZQ9If55-jSqgIoqi-rUu1ZMNZQk7koc0ph8O9xqvn1jpC8ZiSpv_a9qksE9wcI2JQQd4dmhh3zEz8UgQLhcZIrDFSG2Yhl8EKXMMM9k7HHtx8ngoASi6GVqDPdkQv3P9K4jrssqzKmgH6zks9EftRTBsct3YJbErETcQ Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: 78251e5bdb2548d1bb18aacd4ccbcd34 Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:12:07.652134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:12:07.654186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78251e5bdb2548d1bb18aacd4ccbcd34"}]}] Aug 26 11:12:07.654186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:12:07.654186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: 78251e5bdb2548d1bb18aacd4ccbcd34 Aug 26 11:12:07.654186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:12:07.654186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-AttachVolumeShelveTestJSON-1222277151-project Aug 26 11:12:07.654186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:12:07.654186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:12:07.654186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: aedac3f62dd94f87b968f6c71d68a0a3 Aug 26 11:12:07.654186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1222277151-project Aug 26 11:12:07.654186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:12:07.654186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. Aug 26 11:12:07.654186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': 'f3983ebc-9955-4f0c-9ffd-0107d1a22723'} Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:12:07.655311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. Aug 26 11:12:07.657659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:12:07.659084 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-24f4969e-d747-4d5f-bfd8-d8645e7a2c02 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Returning 404 to user: Instance f3983ebc-9955-4f0c-9ffd-0107d1a22723 could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:12:07.659084 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-24f4969e-d747-4d5f-bfd8-d8645e7a2c02 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723" status: 404 len: 111 microversion: 2.20 time: 0.036564 Aug 26 11:12:07.659084 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 419/816] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:12:07 2022] GET /compute/v2.1/servers/f3983ebc-9955-4f0c-9ffd-0107d1a22723 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 11:12:08.813940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a0a3ebef-535f-476a-ac6e-1cdaead01e75 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:08.814544 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a0a3ebef-535f-476a-ac6e-1cdaead01e75 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:08.825001 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0a3ebef-535f-476a-ac6e-1cdaead01e75 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:08.825001 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0a3ebef-535f-476a-ac6e-1cdaead01e75 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:08.825001 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0a3ebef-535f-476a-ac6e-1cdaead01e75 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:08.825001 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0a3ebef-535f-476a-ac6e-1cdaead01e75 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:08.825531 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0a3ebef-535f-476a-ac6e-1cdaead01e75 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:08.825531 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0a3ebef-535f-476a-ac6e-1cdaead01e75 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:08.838998 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-a0a3ebef-535f-476a-ac6e-1cdaead01e75 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] HTTP exception thrown: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a0a3ebef-535f-476a-ac6e-1cdaead01e75 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Request method failure captured: Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: DELETE /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 HTTP/1.1 Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKjRFHZ44GBZQ9If55-jSqgIoqi-rUu1ZMNZQk7koc0ph8O9xqvn1jpC8ZiSpv_a9qksE9wcI2JQQd4dmhh3zEz8UgQLhcZIrDFSG2Yhl8EKXMMM9k7HHtx8ngoASi6GVqDPdkQv3P9K4jrssqzKmgH6zks9EftRTBsct3YJbErETcQ Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: 78251e5bdb2548d1bb18aacd4ccbcd34 Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:12:08.840614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:12:08.842825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78251e5bdb2548d1bb18aacd4ccbcd34"}]}] Aug 26 11:12:08.842825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:12:08.842825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 78251e5bdb2548d1bb18aacd4ccbcd34 Aug 26 11:12:08.842825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:12:08.842825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeShelveTestJSON-1222277151-project Aug 26 11:12:08.842825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:12:08.842825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:12:08.842825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: aedac3f62dd94f87b968f6c71d68a0a3 Aug 26 11:12:08.842825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1222277151-project Aug 26 11:12:08.842825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:12:08.842825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. Aug 26 11:12:08.842825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': '01ae91d9-0521-4d14-b2b6-e56f249c4181'} Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:12:08.843687 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. Aug 26 11:12:08.844870 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:08.846487 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a0a3ebef-535f-476a-ac6e-1cdaead01e75 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Returning 404 to user: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:12:08.846487 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a0a3ebef-535f-476a-ac6e-1cdaead01e75 tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "DELETE /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 404 len: 111 microversion: 2.20 time: 0.033543 Aug 26 11:12:08.846487 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 398/817] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Aug 26 11:12:08 2022] DELETE /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 11:12:08.852310 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-ec5f4973-89f0-4082-855c-a33737e3ed5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:08.853004 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-ec5f4973-89f0-4082-855c-a33737e3ed5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] [instance: 01ae91d9-0521-4d14-b2b6-e56f249c4181] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:08.860741 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ec5f4973-89f0-4082-855c-a33737e3ed5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:08.861329 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ec5f4973-89f0-4082-855c-a33737e3ed5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:08.861829 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ec5f4973-89f0-4082-855c-a33737e3ed5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:08.862649 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ec5f4973-89f0-4082-855c-a33737e3ed5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:08.863167 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ec5f4973-89f0-4082-855c-a33737e3ed5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:08.863653 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-ec5f4973-89f0-4082-855c-a33737e3ed5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:08.882301 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-ec5f4973-89f0-4082-855c-a33737e3ed5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] HTTP exception thrown: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-ec5f4973-89f0-4082-855c-a33737e3ed5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Request method failure captured: Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 HTTP/1.1 Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKjRFHZ44GBZQ9If55-jSqgIoqi-rUu1ZMNZQk7koc0ph8O9xqvn1jpC8ZiSpv_a9qksE9wcI2JQQd4dmhh3zEz8UgQLhcZIrDFSG2Yhl8EKXMMM9k7HHtx8ngoASi6GVqDPdkQv3P9K4jrssqzKmgH6zks9EftRTBsct3YJbErETcQ Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: 78251e5bdb2548d1bb18aacd4ccbcd34 Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:12:08.884014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:12:08.886472 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78251e5bdb2548d1bb18aacd4ccbcd34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78251e5bdb2548d1bb18aacd4ccbcd34"}]}] Aug 26 11:12:08.886472 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:12:08.886472 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: 78251e5bdb2548d1bb18aacd4ccbcd34 Aug 26 11:12:08.886472 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1222277151 Aug 26 11:12:08.886472 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-AttachVolumeShelveTestJSON-1222277151-project Aug 26 11:12:08.886472 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:12:08.886472 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:12:08.886472 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: aedac3f62dd94f87b968f6c71d68a0a3 Aug 26 11:12:08.886472 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1222277151-project Aug 26 11:12:08.886472 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:12:08.886472 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. Aug 26 11:12:08.886472 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': '01ae91d9-0521-4d14-b2b6-e56f249c4181'} Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:12:08.888443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. Aug 26 11:12:08.890793 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:12:08.892187 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-ec5f4973-89f0-4082-855c-a33737e3ed5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] Returning 404 to user: Instance 01ae91d9-0521-4d14-b2b6-e56f249c4181 could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:12:08.892187 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-ec5f4973-89f0-4082-855c-a33737e3ed5b tempest-AttachVolumeShelveTestJSON-1222277151 tempest-AttachVolumeShelveTestJSON-1222277151-project] 10.222.0.40 "GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181" status: 404 len: 111 microversion: 2.20 time: 0.038256 Aug 26 11:12:08.892187 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 420/818] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 11:12:08 2022] GET /compute/v2.1/servers/01ae91d9-0521-4d14-b2b6-e56f249c4181 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 11:12:15.509087 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3cf74a8a-4587-45db-ab9f-a33ecd0cd2ab tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] Calling method '.version_select at 0x7f1a68886280>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:15.559544 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3cf74a8a-4587-45db-ab9f-a33ecd0cd2ab tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/1d48cf37-ba7a-4d29-bfe5-8e4d1ac125f2" status: 200 len: 351 microversion: 2.1 time: 0.054649 Aug 26 11:12:15.560670 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 399/819] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 11:12:15 2022] GET /compute/v2.1/os-volumes/1d48cf37-ba7a-4d29-bfe5-8e4d1ac125f2 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:12:16.932292 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-e0f8de69-6c03-4f55-be55-d07ddcbbc829 tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] Calling method '.version_select at 0x7f1a68829550>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:16.981064 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-e0f8de69-6c03-4f55-be55-d07ddcbbc829 tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/15158b13-d098-4f57-9f3f-7a9dd335c4ed" status: 200 len: 351 microversion: 2.1 time: 0.052510 Aug 26 11:12:16.982460 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 421/820] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 11:12:16 2022] GET /compute/v2.1/os-volumes/15158b13-d098-4f57-9f3f-7a9dd335c4ed => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:12:18.346008 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6f7138f6-526f-4aa6-be9c-fee9c5162cf5 tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] Calling method '.version_select at 0x7f1a68874d30>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:18.393352 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6f7138f6-526f-4aa6-be9c-fee9c5162cf5 tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/983472d8-9442-44cd-be80-96ba13777db3" status: 200 len: 351 microversion: 2.1 time: 0.052257 Aug 26 11:12:18.393926 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 400/821] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 11:12:18 2022] GET /compute/v2.1/os-volumes/983472d8-9442-44cd-be80-96ba13777db3 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:12:18.407560 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-0993ee29-77ca-44ba-b6fd-c51ddc8abd7f tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] Calling method '.version_select at 0x7f1a688761f0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:18.491033 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-0993ee29-77ca-44ba-b6fd-c51ddc8abd7f tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088120 Aug 26 11:12:18.492090 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 422/822] 10.222.0.40 () {58 vars in 1134 bytes} [Fri Aug 26 11:12:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:18.510906 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1739b091-5f2c-4841-b621-f5eb319553ef tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] Calling method '.version_select at 0x7f1a6887c310>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:18.597016 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1739b091-5f2c-4841-b621-f5eb319553ef tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.091580 Aug 26 11:12:18.597597 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 401/823] 10.222.0.40 () {58 vars in 1149 bytes} [Fri Aug 26 11:12:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:12:18.611224 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-be97464a-38e4-4bd9-9207-aae365cb77b2 tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] Calling method '.version_select at 0x7f1a687b70d0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:18.700843 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-be97464a-38e4-4bd9-9207-aae365cb77b2 tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.093354 Aug 26 11:12:18.701402 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 423/824] 10.222.0.40 () {58 vars in 1134 bytes} [Fri Aug 26 11:12:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:18.714096 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2b9fa22d-384a-4b99-a644-76d677d71ca8 tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] Calling method '.version_select at 0x7f1a68853940>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:18.806781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2b9fa22d-384a-4b99-a644-76d677d71ca8 tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.096435 Aug 26 11:12:18.807351 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 402/825] 10.222.0.40 () {58 vars in 1167 bytes} [Fri Aug 26 11:12:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:12:18.820407 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a0129156-336e-40af-abce-1e659d4fdd68 tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] Calling method '.version_select at 0x7f1a688291f0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:18.857864 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:12:18.869425 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:12:18.910848 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-a0129156-336e-40af-abce-1e659d4fdd68 tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.094204 Aug 26 11:12:18.911411 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 424/826] 10.222.0.40 () {58 vars in 1170 bytes} [Fri Aug 26 11:12:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:12:18.922038 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=7 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:12:18.922806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:12:18.927234 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-43d60eac-7196-4c41-b73e-a0b12ef4d9bb tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] Calling method '.version_select at 0x7f1a6884fa60>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:19.171763 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-43d60eac-7196-4c41-b73e-a0b12ef4d9bb tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.250352 Aug 26 11:12:19.172388 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 403/827] 10.222.0.40 () {58 vars in 1155 bytes} [Fri Aug 26 11:12:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:19.186075 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f1133d07-58a1-4833-85bf-68ff63fe45e9 tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] Calling method '.version_select at 0x7f1a68a670d0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:19.270904 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f1133d07-58a1-4833-85bf-68ff63fe45e9 tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089383 Aug 26 11:12:19.271470 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 425/828] 10.222.0.40 () {58 vars in 1188 bytes} [Fri Aug 26 11:12:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:12:19.284690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8f692350-15fe-4e84-bbe9-1400f0f3c425 tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] Calling method '.version_select at 0x7f1a688bc670>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:19.370301 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8f692350-15fe-4e84-bbe9-1400f0f3c425 tempest-VolumesTestJSON-1689007315 tempest-VolumesTestJSON-1689007315-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.089637 Aug 26 11:12:19.370949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 404/829] 10.222.0.40 () {58 vars in 1155 bytes} [Fri Aug 26 11:12:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:22.725478 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4f1ec721-d094-4b3a-a1c1-1baa274cf5e5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:22.726088 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4f1ec721-d094-4b3a-a1c1-1baa274cf5e5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:22.733348 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f1ec721-d094-4b3a-a1c1-1baa274cf5e5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:22.734193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f1ec721-d094-4b3a-a1c1-1baa274cf5e5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:22.734635 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f1ec721-d094-4b3a-a1c1-1baa274cf5e5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:22.735351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f1ec721-d094-4b3a-a1c1-1baa274cf5e5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:22.735782 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f1ec721-d094-4b3a-a1c1-1baa274cf5e5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:22.736200 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f1ec721-d094-4b3a-a1c1-1baa274cf5e5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:22.761940 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4f1ec721-d094-4b3a-a1c1-1baa274cf5e5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1/ips" status: 200 len: 148 microversion: 2.1 time: 0.040906 Aug 26 11:12:22.762535 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 426/830] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 11:12:22 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:12:22.778281 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8cd2d2cb-04db-4ab2-a978-0e75215489c5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58ff6b79-bce6-4cfa-bf00-f43699bc1d4b"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:12:22.780611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8cd2d2cb-04db-4ab2-a978-0e75215489c5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:22.786788 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8cd2d2cb-04db-4ab2-a978-0e75215489c5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:22.787270 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8cd2d2cb-04db-4ab2-a978-0e75215489c5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:22.787704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8cd2d2cb-04db-4ab2-a978-0e75215489c5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:22.788409 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8cd2d2cb-04db-4ab2-a978-0e75215489c5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:22.788864 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8cd2d2cb-04db-4ab2-a978-0e75215489c5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:22.789291 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8cd2d2cb-04db-4ab2-a978-0e75215489c5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:22.881772 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-8cd2d2cb-04db-4ab2-a978-0e75215489c5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] HTTP exception thrown: Invalid volume: volume 58ff6b79-bce6-4cfa-bf00-f43699bc1d4b is already attached to instances: b1845fcd-057b-4fc1-8761-a09197883c62 Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8cd2d2cb-04db-4ab2-a978-0e75215489c5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Request method failure captured: Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: POST /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1/os-volume_attachments HTTP/1.1 Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 74 Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKoS760bbZGFLZIOtz0bKN10taydUPpuaCKVzX6gMaWx7hZAZTvcJMm_yZoNCB5lp_e9MQjhaY7MeAuvI46fhuwxrStFhmWy1UiPbfomblZkYtULFDPdpOJqpKIXIq_HGXEQgCHtVLesHEPgZPUJF6lSZ6rQfXeWj1bDY2Cb8a6cLCs Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:12:22.883437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:12:22.885125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}] Aug 26 11:12:22.885125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:12:22.885125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:12:22.885125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:12:22.885125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:12:22.885125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:12:22.885125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:12:22.885125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 85716f53e88048af9a8fdcbe4415979c Aug 26 11:12:22.885125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:12:22.885125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Aug 26 11:12:22.885125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {"volumeAttachment": {"volumeId": "58ff6b79-bce6-4cfa-bf00-f43699bc1d4b"}} Aug 26 11:12:22.885125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Invalid volume: volume 58ff6b79-bce6-4cfa-bf00-f43699bc1d4b is already attached to instances: b1845fcd-057b-4fc1-8761-a09197883c62 Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'server_id': 'f84ff179-7a07-42bc-9fe4-689622b81ef1', 'body': {'volumeAttachment': {'volumeId': '58ff6b79-bce6-4cfa-bf00-f43699bc1d4b'}}} Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 58ff6b79-bce6-4cfa-bf00-f43699bc1d4b is already attached to instances: b1845fcd-057b-4fc1-8761-a09197883c62 Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:22.885939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 58ff6b79-bce6-4cfa-bf00-f43699bc1d4b is already attached to instances: b1845fcd-057b-4fc1-8761-a09197883c62 Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:22.887203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:12:22.888435 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:12:22.888435 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:12:22.888435 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:12:22.888435 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 58ff6b79-bce6-4cfa-bf00-f43699bc1d4b is already attached to instances: b1845fcd-057b-4fc1-8761-a09197883c62 Aug 26 11:12:22.888435 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:22.888435 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8cd2d2cb-04db-4ab2-a978-0e75215489c5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Returning 400 to user: Invalid volume: volume 58ff6b79-bce6-4cfa-bf00-f43699bc1d4b is already attached to instances: b1845fcd-057b-4fc1-8761-a09197883c62 {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:12:22.888435 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8cd2d2cb-04db-4ab2-a978-0e75215489c5 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "POST /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111826 Aug 26 11:12:22.888435 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 405/831] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 11:12:22 2022] POST /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 11:12:22.898045 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-00b7d6c0-6480-412e-b4f2-134799d9b409 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:22.898544 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-00b7d6c0-6480-412e-b4f2-134799d9b409 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:22.904694 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-00b7d6c0-6480-412e-b4f2-134799d9b409 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:22.905504 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-00b7d6c0-6480-412e-b4f2-134799d9b409 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:22.905954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-00b7d6c0-6480-412e-b4f2-134799d9b409 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:22.908176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-00b7d6c0-6480-412e-b4f2-134799d9b409 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:22.908176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-00b7d6c0-6480-412e-b4f2-134799d9b409 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:22.908176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-00b7d6c0-6480-412e-b4f2-134799d9b409 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:22.935422 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-00b7d6c0-6480-412e-b4f2-134799d9b409 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Going to try to terminate instance {{(pid=120605) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:12:23.030607 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-00b7d6c0-6480-412e-b4f2-134799d9b409 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 204 len: 0 microversion: 2.1 time: 0.136075 Aug 26 11:12:23.031497 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 427/832] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:12:22 2022] DELETE /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 11:12:23.041052 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6d0aa9de-f97d-4231-ae55-7b98b3d4b13a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:23.042213 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6d0aa9de-f97d-4231-ae55-7b98b3d4b13a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:23.049481 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6d0aa9de-f97d-4231-ae55-7b98b3d4b13a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:23.050004 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6d0aa9de-f97d-4231-ae55-7b98b3d4b13a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:23.050443 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6d0aa9de-f97d-4231-ae55-7b98b3d4b13a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:23.051150 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6d0aa9de-f97d-4231-ae55-7b98b3d4b13a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:23.051696 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6d0aa9de-f97d-4231-ae55-7b98b3d4b13a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:23.052129 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6d0aa9de-f97d-4231-ae55-7b98b3d4b13a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:23.205286 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6d0aa9de-f97d-4231-ae55-7b98b3d4b13a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:23.215536 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6d0aa9de-f97d-4231-ae55-7b98b3d4b13a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 200 len: 1679 microversion: 2.1 time: 0.179156 Aug 26 11:12:23.225998 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 406/833] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:23 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:12:24.244121 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-29b2fcdc-86fd-4217-a1e2-ff1a0fafa2fc tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:24.245285 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-29b2fcdc-86fd-4217-a1e2-ff1a0fafa2fc tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:24.258190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29b2fcdc-86fd-4217-a1e2-ff1a0fafa2fc tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:24.258915 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29b2fcdc-86fd-4217-a1e2-ff1a0fafa2fc tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:24.259415 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29b2fcdc-86fd-4217-a1e2-ff1a0fafa2fc tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:24.261011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29b2fcdc-86fd-4217-a1e2-ff1a0fafa2fc tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:24.261550 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29b2fcdc-86fd-4217-a1e2-ff1a0fafa2fc tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:24.262239 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-29b2fcdc-86fd-4217-a1e2-ff1a0fafa2fc tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:24.414799 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-29b2fcdc-86fd-4217-a1e2-ff1a0fafa2fc tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:24.425997 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-29b2fcdc-86fd-4217-a1e2-ff1a0fafa2fc tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 200 len: 1679 microversion: 2.1 time: 0.189309 Aug 26 11:12:24.426969 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 428/834] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:24 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:25.453047 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-38694549-205e-43ca-8a68-0f846915977b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:25.454354 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-38694549-205e-43ca-8a68-0f846915977b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:25.463549 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38694549-205e-43ca-8a68-0f846915977b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:25.464049 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38694549-205e-43ca-8a68-0f846915977b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:25.464990 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38694549-205e-43ca-8a68-0f846915977b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:25.465724 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38694549-205e-43ca-8a68-0f846915977b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:25.466210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38694549-205e-43ca-8a68-0f846915977b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:25.466874 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38694549-205e-43ca-8a68-0f846915977b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:25.545128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-38694549-205e-43ca-8a68-0f846915977b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:25.557070 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-e4067dfe-c40a-4c39-8397-bac2e10d57bb req-ad8a8dfe-0495-4970-bf6f-3b8a027152b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84ff179-7a07-42bc-9fe4-689622b81ef1", "name": "network-vif-deleted", "tag": "75d50641-5f7f-466e-8c43-62df59ab2567"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:12:25.557619 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-38694549-205e-43ca-8a68-0f846915977b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 200 len: 1611 microversion: 2.1 time: 0.111835 Aug 26 11:12:25.558614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 407/835] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:25 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 1611 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:25.572934 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-e4067dfe-c40a-4c39-8397-bac2e10d57bb req-ad8a8dfe-0495-4970-bf6f-3b8a027152b0 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:25.573429 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-e4067dfe-c40a-4c39-8397-bac2e10d57bb req-ad8a8dfe-0495-4970-bf6f-3b8a027152b0 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:25.573934 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-e4067dfe-c40a-4c39-8397-bac2e10d57bb req-ad8a8dfe-0495-4970-bf6f-3b8a027152b0 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:25.589446 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-e4067dfe-c40a-4c39-8397-bac2e10d57bb req-ad8a8dfe-0495-4970-bf6f-3b8a027152b0 service nova] Creating event network-vif-deleted:75d50641-5f7f-466e-8c43-62df59ab2567 for instance f84ff179-7a07-42bc-9fe4-689622b81ef1 on hv-cinder-85236 Aug 26 11:12:25.596555 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-e4067dfe-c40a-4c39-8397-bac2e10d57bb req-ad8a8dfe-0495-4970-bf6f-3b8a027152b0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042418 Aug 26 11:12:25.597652 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 429/836] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:12:26.587378 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-321792e1-8c95-40e1-8245-1d854a46af75 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:26.589581 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-321792e1-8c95-40e1-8245-1d854a46af75 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:26.601103 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-321792e1-8c95-40e1-8245-1d854a46af75 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:26.602435 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-321792e1-8c95-40e1-8245-1d854a46af75 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:26.610610 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-321792e1-8c95-40e1-8245-1d854a46af75 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:26.610610 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-321792e1-8c95-40e1-8245-1d854a46af75 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:26.610610 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-321792e1-8c95-40e1-8245-1d854a46af75 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:26.610610 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-321792e1-8c95-40e1-8245-1d854a46af75 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:26.628942 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-321792e1-8c95-40e1-8245-1d854a46af75 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] HTTP exception thrown: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-321792e1-8c95-40e1-8245-1d854a46af75 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Request method failure captured: Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 HTTP/1.1 Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKoS760bbZGFLZIOtz0bKN10taydUPpuaCKVzX6gMaWx7hZAZTvcJMm_yZoNCB5lp_e9MQjhaY7MeAuvI46fhuwxrStFhmWy1UiPbfomblZkYtULFDPdpOJqpKIXIq_HGXEQgCHtVLesHEPgZPUJF6lSZ6rQfXeWj1bDY2Cb8a6cLCs Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:12:26.631251 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:12:26.632905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}] Aug 26 11:12:26.632905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:12:26.632905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:12:26.632905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:12:26.632905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:12:26.632905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:12:26.632905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:12:26.632905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 85716f53e88048af9a8fdcbe4415979c Aug 26 11:12:26.632905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:12:26.632905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:12:26.632905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. Aug 26 11:12:26.632905 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'f84ff179-7a07-42bc-9fe4-689622b81ef1'} Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:12:26.633745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. Aug 26 11:12:26.635167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:26.637280 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-321792e1-8c95-40e1-8245-1d854a46af75 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Returning 404 to user: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:12:26.638364 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-321792e1-8c95-40e1-8245-1d854a46af75 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 404 len: 111 microversion: 2.1 time: 0.060175 Aug 26 11:12:26.639822 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 408/837] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:26 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:12:26.649168 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-be022c67-d00f-4c36-ac70-baeeb3672059 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '.version_select at 0x7f1a687b7ca0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:26.674124 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-be022c67-d00f-4c36-ac70-baeeb3672059 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-277066715" status: 202 len: 0 microversion: 2.1 time: 0.029239 Aug 26 11:12:26.674720 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 430/838] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 26 11:12:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-277066715 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 11:12:27.401560 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4354256a-225e-4745-a7ed-4fb67e3c2504 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:27.402074 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4354256a-225e-4745-a7ed-4fb67e3c2504 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:27.409218 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4354256a-225e-4745-a7ed-4fb67e3c2504 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:27.409699 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4354256a-225e-4745-a7ed-4fb67e3c2504 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:27.410158 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4354256a-225e-4745-a7ed-4fb67e3c2504 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:27.410855 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4354256a-225e-4745-a7ed-4fb67e3c2504 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:27.411303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4354256a-225e-4745-a7ed-4fb67e3c2504 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:27.411721 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4354256a-225e-4745-a7ed-4fb67e3c2504 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:27.496977 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-4354256a-225e-4745-a7ed-4fb67e3c2504 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lazy-loading 'services' on Instance uuid b1845fcd-057b-4fc1-8761-a09197883c62 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:12:27.572458 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4354256a-225e-4745-a7ed-4fb67e3c2504 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62/os-volume_attachments/58ff6b79-bce6-4cfa-bf00-f43699bc1d4b" status: 202 len: 0 microversion: 2.1 time: 0.175111 Aug 26 11:12:27.573048 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 409/839] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 11:12:27 2022] DELETE /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62/os-volume_attachments/58ff6b79-bce6-4cfa-bf00-f43699bc1d4b => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:12:27.582333 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-e3002194-355d-4c73-a3cc-03c09f5ff9ba tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:27.584516 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e3002194-355d-4c73-a3cc-03c09f5ff9ba tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:27.591604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3002194-355d-4c73-a3cc-03c09f5ff9ba tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:27.592658 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3002194-355d-4c73-a3cc-03c09f5ff9ba tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:27.593099 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3002194-355d-4c73-a3cc-03c09f5ff9ba tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:27.594081 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3002194-355d-4c73-a3cc-03c09f5ff9ba tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:27.594312 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3002194-355d-4c73-a3cc-03c09f5ff9ba tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:27.594735 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e3002194-355d-4c73-a3cc-03c09f5ff9ba tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:27.625758 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-e3002194-355d-4c73-a3cc-03c09f5ff9ba tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047537 Aug 26 11:12:27.626358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 431/840] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:12:27 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:12:28.639907 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e848858c-c81f-4de1-804c-37c2bd76df42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:28.642491 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e848858c-c81f-4de1-804c-37c2bd76df42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:28.649107 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e848858c-c81f-4de1-804c-37c2bd76df42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:28.649592 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e848858c-c81f-4de1-804c-37c2bd76df42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:28.650054 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e848858c-c81f-4de1-804c-37c2bd76df42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:28.650754 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e848858c-c81f-4de1-804c-37c2bd76df42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:28.651196 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e848858c-c81f-4de1-804c-37c2bd76df42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:28.651614 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e848858c-c81f-4de1-804c-37c2bd76df42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:28.682487 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e848858c-c81f-4de1-804c-37c2bd76df42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048291 Aug 26 11:12:28.683057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 410/841] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:12:28 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:12:29.696143 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-785a667c-da3c-458f-aa17-c10190ca8782 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:29.698312 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-785a667c-da3c-458f-aa17-c10190ca8782 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:29.705925 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-785a667c-da3c-458f-aa17-c10190ca8782 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:29.706438 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-785a667c-da3c-458f-aa17-c10190ca8782 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:29.706869 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-785a667c-da3c-458f-aa17-c10190ca8782 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:29.707573 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-785a667c-da3c-458f-aa17-c10190ca8782 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:29.708018 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-785a667c-da3c-458f-aa17-c10190ca8782 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:29.708434 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-785a667c-da3c-458f-aa17-c10190ca8782 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:29.741493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-785a667c-da3c-458f-aa17-c10190ca8782 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049356 Aug 26 11:12:29.742094 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 432/842] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:12:29 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:12:30.753817 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-43cfb04c-fc73-4941-adc8-eb7cb6d308b2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:30.756117 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-43cfb04c-fc73-4941-adc8-eb7cb6d308b2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:30.763423 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43cfb04c-fc73-4941-adc8-eb7cb6d308b2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:30.764464 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43cfb04c-fc73-4941-adc8-eb7cb6d308b2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:30.764906 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43cfb04c-fc73-4941-adc8-eb7cb6d308b2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:30.765622 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43cfb04c-fc73-4941-adc8-eb7cb6d308b2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:30.766214 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43cfb04c-fc73-4941-adc8-eb7cb6d308b2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:30.766763 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43cfb04c-fc73-4941-adc8-eb7cb6d308b2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:30.804943 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-43cfb04c-fc73-4941-adc8-eb7cb6d308b2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055008 Aug 26 11:12:30.805527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 411/843] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:12:30 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 11:12:30.885064 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-390fe625-e957-4a0d-85f4-1b59a6efcbf7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:30.885563 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-390fe625-e957-4a0d-85f4-1b59a6efcbf7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:30.892815 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-390fe625-e957-4a0d-85f4-1b59a6efcbf7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:30.893306 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-390fe625-e957-4a0d-85f4-1b59a6efcbf7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:30.893872 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-390fe625-e957-4a0d-85f4-1b59a6efcbf7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:30.894527 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-390fe625-e957-4a0d-85f4-1b59a6efcbf7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:30.895023 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-390fe625-e957-4a0d-85f4-1b59a6efcbf7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:30.895300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-390fe625-e957-4a0d-85f4-1b59a6efcbf7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:30.922521 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-390fe625-e957-4a0d-85f4-1b59a6efcbf7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Going to try to terminate instance {{(pid=120605) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:12:31.012262 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-390fe625-e957-4a0d-85f4-1b59a6efcbf7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 204 len: 0 microversion: 2.1 time: 0.130631 Aug 26 11:12:31.012996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 433/844] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:12:30 2022] DELETE /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:12:31.027296 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f92e1811-668f-4af0-83b1-e76121c21493 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:31.029918 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f92e1811-668f-4af0-83b1-e76121c21493 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:31.040842 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f92e1811-668f-4af0-83b1-e76121c21493 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:31.041559 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f92e1811-668f-4af0-83b1-e76121c21493 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:31.042231 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f92e1811-668f-4af0-83b1-e76121c21493 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:31.043256 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f92e1811-668f-4af0-83b1-e76121c21493 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:31.043912 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f92e1811-668f-4af0-83b1-e76121c21493 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:31.044526 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f92e1811-668f-4af0-83b1-e76121c21493 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:31.197386 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f92e1811-668f-4af0-83b1-e76121c21493 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:31.206371 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f92e1811-668f-4af0-83b1-e76121c21493 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 200 len: 1681 microversion: 2.1 time: 0.186282 Aug 26 11:12:31.207197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 412/845] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:31 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:32.234477 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1bdf79fe-d86a-4ea1-8e19-ed5afac9d7e7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:32.235093 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-1bdf79fe-d86a-4ea1-8e19-ed5afac9d7e7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:32.241550 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1bdf79fe-d86a-4ea1-8e19-ed5afac9d7e7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:32.242068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1bdf79fe-d86a-4ea1-8e19-ed5afac9d7e7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:32.242509 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1bdf79fe-d86a-4ea1-8e19-ed5afac9d7e7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:32.243258 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1bdf79fe-d86a-4ea1-8e19-ed5afac9d7e7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:32.243667 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1bdf79fe-d86a-4ea1-8e19-ed5afac9d7e7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:32.244088 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1bdf79fe-d86a-4ea1-8e19-ed5afac9d7e7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:32.390058 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1bdf79fe-d86a-4ea1-8e19-ed5afac9d7e7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:32.397814 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1bdf79fe-d86a-4ea1-8e19-ed5afac9d7e7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 200 len: 1681 microversion: 2.1 time: 0.168048 Aug 26 11:12:32.398416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 434/846] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:32 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:33.420766 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5a9ba470-754c-4203-a99b-d7bb98404a46 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:33.421465 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5a9ba470-754c-4203-a99b-d7bb98404a46 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:33.427935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a9ba470-754c-4203-a99b-d7bb98404a46 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:33.428418 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a9ba470-754c-4203-a99b-d7bb98404a46 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:33.428850 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a9ba470-754c-4203-a99b-d7bb98404a46 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:33.429550 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a9ba470-754c-4203-a99b-d7bb98404a46 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:33.430044 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a9ba470-754c-4203-a99b-d7bb98404a46 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:33.430468 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5a9ba470-754c-4203-a99b-d7bb98404a46 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:33.572307 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5a9ba470-754c-4203-a99b-d7bb98404a46 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:33.583779 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5a9ba470-754c-4203-a99b-d7bb98404a46 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 200 len: 1681 microversion: 2.1 time: 0.167310 Aug 26 11:12:33.584729 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 413/847] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:33 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:12:34.609407 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-15ed2ce8-762a-4b34-ab67-a70fa42544c9 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:34.610043 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-15ed2ce8-762a-4b34-ab67-a70fa42544c9 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:34.616339 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-15ed2ce8-762a-4b34-ab67-a70fa42544c9 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:34.616857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-15ed2ce8-762a-4b34-ab67-a70fa42544c9 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:34.617296 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-15ed2ce8-762a-4b34-ab67-a70fa42544c9 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:34.618024 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-15ed2ce8-762a-4b34-ab67-a70fa42544c9 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:34.618483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-15ed2ce8-762a-4b34-ab67-a70fa42544c9 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:34.618908 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-15ed2ce8-762a-4b34-ab67-a70fa42544c9 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:34.761285 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-15ed2ce8-762a-4b34-ab67-a70fa42544c9 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:34.770229 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-15ed2ce8-762a-4b34-ab67-a70fa42544c9 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 200 len: 1681 microversion: 2.1 time: 0.165235 Aug 26 11:12:34.770806 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 435/848] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:34 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:35.793461 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a0eb9f07-6ad8-4868-9e56-dc3f61dadc68 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:35.795702 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a0eb9f07-6ad8-4868-9e56-dc3f61dadc68 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:35.802917 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0eb9f07-6ad8-4868-9e56-dc3f61dadc68 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:35.803803 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0eb9f07-6ad8-4868-9e56-dc3f61dadc68 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:35.804308 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0eb9f07-6ad8-4868-9e56-dc3f61dadc68 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:35.805367 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0eb9f07-6ad8-4868-9e56-dc3f61dadc68 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:35.805890 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0eb9f07-6ad8-4868-9e56-dc3f61dadc68 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:35.806585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0eb9f07-6ad8-4868-9e56-dc3f61dadc68 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:35.911897 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a0eb9f07-6ad8-4868-9e56-dc3f61dadc68 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:35.930249 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a0eb9f07-6ad8-4868-9e56-dc3f61dadc68 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 200 len: 1613 microversion: 2.1 time: 0.140594 Aug 26 11:12:35.938038 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 414/849] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:35 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 1613 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:35.970446 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-db96ae60-35e1-46ee-9ffc-c51140e2f9dc req-3553560c-27b5-4473-92f9-65e70067fd75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1845fcd-057b-4fc1-8761-a09197883c62", "name": "network-vif-deleted", "tag": "f66a5627-6854-4d78-a90c-0acc02bef2c9"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:12:35.995729 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-db96ae60-35e1-46ee-9ffc-c51140e2f9dc req-3553560c-27b5-4473-92f9-65e70067fd75 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:36.001963 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-db96ae60-35e1-46ee-9ffc-c51140e2f9dc req-3553560c-27b5-4473-92f9-65e70067fd75 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:36.005803 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-db96ae60-35e1-46ee-9ffc-c51140e2f9dc req-3553560c-27b5-4473-92f9-65e70067fd75 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:36.044534 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-db96ae60-35e1-46ee-9ffc-c51140e2f9dc req-3553560c-27b5-4473-92f9-65e70067fd75 service nova] Creating event network-vif-deleted:f66a5627-6854-4d78-a90c-0acc02bef2c9 for instance b1845fcd-057b-4fc1-8761-a09197883c62 on hv-cinder-85236 Aug 26 11:12:36.061103 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-db96ae60-35e1-46ee-9ffc-c51140e2f9dc req-3553560c-27b5-4473-92f9-65e70067fd75 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093295 Aug 26 11:12:36.064867 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 436/850] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:12:36.960411 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8b991075-fb71-4764-9126-97786ce10570 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:36.961203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8b991075-fb71-4764-9126-97786ce10570 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:36.971743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8b991075-fb71-4764-9126-97786ce10570 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:36.972885 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8b991075-fb71-4764-9126-97786ce10570 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:36.973923 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8b991075-fb71-4764-9126-97786ce10570 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:36.975237 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8b991075-fb71-4764-9126-97786ce10570 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:36.975875 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8b991075-fb71-4764-9126-97786ce10570 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:36.977035 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8b991075-fb71-4764-9126-97786ce10570 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:36.999228 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-8b991075-fb71-4764-9126-97786ce10570 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] HTTP exception thrown: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8b991075-fb71-4764-9126-97786ce10570 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Request method failure captured: Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 HTTP/1.1 Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKoS760bbZGFLZIOtz0bKN10taydUPpuaCKVzX6gMaWx7hZAZTvcJMm_yZoNCB5lp_e9MQjhaY7MeAuvI46fhuwxrStFhmWy1UiPbfomblZkYtULFDPdpOJqpKIXIq_HGXEQgCHtVLesHEPgZPUJF6lSZ6rQfXeWj1bDY2Cb8a6cLCs Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:12:37.001611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:12:37.003007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}] Aug 26 11:12:37.003007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:12:37.003007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:12:37.003007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:12:37.003007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:12:37.003007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:12:37.003007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:12:37.003007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 85716f53e88048af9a8fdcbe4415979c Aug 26 11:12:37.003007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:12:37.003007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:12:37.003007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. Aug 26 11:12:37.003007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'b1845fcd-057b-4fc1-8761-a09197883c62'} Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:12:37.003733 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. Aug 26 11:12:37.004940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:12:37.006103 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8b991075-fb71-4764-9126-97786ce10570 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Returning 404 to user: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:12:37.006103 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8b991075-fb71-4764-9126-97786ce10570 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 404 len: 111 microversion: 2.1 time: 0.050430 Aug 26 11:12:37.006103 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 415/851] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:36 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:12:37.012984 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-8d8caf52-2f9b-4712-800e-cc15d963a0ae tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '.version_select at 0x7f1a688299d0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:37.041145 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-8d8caf52-2f9b-4712-800e-cc15d963a0ae tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323272780" status: 202 len: 0 microversion: 2.1 time: 0.032246 Aug 26 11:12:37.041737 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 437/852] 10.222.0.40 () {58 vars in 1221 bytes} [Fri Aug 26 11:12:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323272780 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:12:37.778346 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1cb092d9-fa84-4ffe-997f-9bffe12648ed tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Action: 'create', calling method: .version_select at 0x7f1a688b3c10>, body: {"keypair": {"name": "tempest-keypair-1311972575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOgQaKz1Vp01H1pUC2CuSZKac/z4801UgDqfEXaTs3oXGXQkzV/315lHogyq4WiKk3gdug9q3SEgJQhH9mRCu2wnJ70Bi6md/q8OycYaE4KsXKqGJPUVTgebmi74RwGtA=="}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:12:37.799857 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-1cb092d9-fa84-4ffe-997f-9bffe12648ed tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Getting quotas for project f780402b93f94d26b2fceab83c0bf485. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:12:37.803765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-1cb092d9-fa84-4ffe-997f-9bffe12648ed tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Getting quotas for user 85716f53e88048af9a8fdcbe4415979c and project f780402b93f94d26b2fceab83c0bf485. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:12:37.828179 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1cb092d9-fa84-4ffe-997f-9bffe12648ed tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054028 Aug 26 11:12:37.829071 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 416/853] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 11:12:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:12:39.496577 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1898602147", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad797925-a966-4b56-98aa-95c1629b07a2"}], "security_groups": [{"name": "tempest-securitygroup--1313763768"}], "key_name": "tempest-keypair-1311972575", "user_data": "}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:12:39.603538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.network.neutron [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] validate_networks() for [('ad797925-a966-4b56-98aa-95c1629b07a2', None, None, None, None, None)] {{(pid=120605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:12:40.003306 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Flavor limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:12:40.003913 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Image limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:12:40.004420 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Flavor pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:12:40.004862 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Image pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:12:40.005281 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:12:40.015155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:40.015638 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:40.016076 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:40.016804 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:40.017260 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:40.017801 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:40.036663 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Getting quotas for project f780402b93f94d26b2fceab83c0bf485. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:12:40.041503 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Getting quotas for user 85716f53e88048af9a8fdcbe4415979c and project f780402b93f94d26b2fceab83c0bf485. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:12:40.057408 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Going to run 1 instances... {{(pid=120605) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:12:40.061006 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:12:40.124316 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-9b9e5748-ccf6-4df5-9330-1c46c24b132e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.631450 Aug 26 11:12:40.130099 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 438/854] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:12:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:12:40.135800 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3f27715d-5d73-4723-9efa-efe8f3853700 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:40.136410 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3f27715d-5d73-4723-9efa-efe8f3853700 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:40.197177 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3f27715d-5d73-4723-9efa-efe8f3853700 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:40.204837 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3f27715d-5d73-4723-9efa-efe8f3853700 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1242 microversion: 2.1 time: 0.073318 Aug 26 11:12:40.205609 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 417/855] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:40 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:12:41.238108 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c81ed549-32b7-45f0-b88e-103496504592 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:41.239516 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c81ed549-32b7-45f0-b88e-103496504592 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:41.246652 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c81ed549-32b7-45f0-b88e-103496504592 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:41.247307 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c81ed549-32b7-45f0-b88e-103496504592 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:41.249770 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c81ed549-32b7-45f0-b88e-103496504592 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:41.250690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c81ed549-32b7-45f0-b88e-103496504592 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:41.251117 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c81ed549-32b7-45f0-b88e-103496504592 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:41.251678 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c81ed549-32b7-45f0-b88e-103496504592 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:41.354791 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c81ed549-32b7-45f0-b88e-103496504592 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:41.371799 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c81ed549-32b7-45f0-b88e-103496504592 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1302 microversion: 2.1 time: 0.147420 Aug 26 11:12:41.376773 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 439/856] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:41 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1302 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:12:42.406204 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ef4e87ef-232f-4f9f-ba16-403d166b9d5d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:42.406835 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ef4e87ef-232f-4f9f-ba16-403d166b9d5d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:42.414792 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ef4e87ef-232f-4f9f-ba16-403d166b9d5d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:42.416236 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ef4e87ef-232f-4f9f-ba16-403d166b9d5d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:42.416884 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ef4e87ef-232f-4f9f-ba16-403d166b9d5d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:42.417805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ef4e87ef-232f-4f9f-ba16-403d166b9d5d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:42.418558 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ef4e87ef-232f-4f9f-ba16-403d166b9d5d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:42.420308 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ef4e87ef-232f-4f9f-ba16-403d166b9d5d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:42.589486 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ef4e87ef-232f-4f9f-ba16-403d166b9d5d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:42.601041 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ef4e87ef-232f-4f9f-ba16-403d166b9d5d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1368 microversion: 2.1 time: 0.209697 Aug 26 11:12:42.601629 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 418/857] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:42 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:12:42.858152 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-11b87ccb-7c97-4b6f-af34-2291e821bee2 req-521b53d3-4260-4368-bfc3-3e1c3023ac10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0e78763-5fe6-49aa-9aaa-f609e352fe01", "tag": "320957d2-f8f3-4863-963f-45200e182701"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:12:42.871168 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-11b87ccb-7c97-4b6f-af34-2291e821bee2 req-521b53d3-4260-4368-bfc3-3e1c3023ac10 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:42.871825 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-11b87ccb-7c97-4b6f-af34-2291e821bee2 req-521b53d3-4260-4368-bfc3-3e1c3023ac10 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:42.872388 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-11b87ccb-7c97-4b6f-af34-2291e821bee2 req-521b53d3-4260-4368-bfc3-3e1c3023ac10 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:42.892305 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-11b87ccb-7c97-4b6f-af34-2291e821bee2 req-521b53d3-4260-4368-bfc3-3e1c3023ac10 service nova] Creating event network-changed:320957d2-f8f3-4863-963f-45200e182701 for instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 on hv-cinder-85236 Aug 26 11:12:42.897257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-11b87ccb-7c97-4b6f-af34-2291e821bee2 req-521b53d3-4260-4368-bfc3-3e1c3023ac10 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044031 Aug 26 11:12:42.897862 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 440/858] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:12:43.621991 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d16f7a5c-b9fd-4222-b861-1f069e9a1fd0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:43.622610 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d16f7a5c-b9fd-4222-b861-1f069e9a1fd0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:43.630305 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d16f7a5c-b9fd-4222-b861-1f069e9a1fd0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:43.630798 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d16f7a5c-b9fd-4222-b861-1f069e9a1fd0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:43.631234 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d16f7a5c-b9fd-4222-b861-1f069e9a1fd0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:43.631942 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d16f7a5c-b9fd-4222-b861-1f069e9a1fd0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:43.632389 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d16f7a5c-b9fd-4222-b861-1f069e9a1fd0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:43.632811 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d16f7a5c-b9fd-4222-b861-1f069e9a1fd0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:43.778408 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d16f7a5c-b9fd-4222-b861-1f069e9a1fd0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:43.787475 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d16f7a5c-b9fd-4222-b861-1f069e9a1fd0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1368 microversion: 2.1 time: 0.169185 Aug 26 11:12:43.788059 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 419/859] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:43 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:44.809114 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-14ad1f2f-596a-46fe-a6af-57ce40629de3 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:44.809833 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-14ad1f2f-596a-46fe-a6af-57ce40629de3 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:44.817629 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-14ad1f2f-596a-46fe-a6af-57ce40629de3 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:44.818157 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-14ad1f2f-596a-46fe-a6af-57ce40629de3 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:44.818772 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-14ad1f2f-596a-46fe-a6af-57ce40629de3 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:44.819495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-14ad1f2f-596a-46fe-a6af-57ce40629de3 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:44.820149 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-14ad1f2f-596a-46fe-a6af-57ce40629de3 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:44.820575 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-14ad1f2f-596a-46fe-a6af-57ce40629de3 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:44.956198 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-14ad1f2f-596a-46fe-a6af-57ce40629de3 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:44.967624 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-14ad1f2f-596a-46fe-a6af-57ce40629de3 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1368 microversion: 2.1 time: 0.162015 Aug 26 11:12:44.968265 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 441/860] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:44 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:45.997634 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-79571bec-e57e-45c7-be81-713516cb9fdf tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:45.998618 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-79571bec-e57e-45c7-be81-713516cb9fdf tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:46.005379 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79571bec-e57e-45c7-be81-713516cb9fdf tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:46.005855 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79571bec-e57e-45c7-be81-713516cb9fdf tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:46.006316 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79571bec-e57e-45c7-be81-713516cb9fdf tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:46.007116 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79571bec-e57e-45c7-be81-713516cb9fdf tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:46.007559 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79571bec-e57e-45c7-be81-713516cb9fdf tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:46.007977 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79571bec-e57e-45c7-be81-713516cb9fdf tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:46.150128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-79571bec-e57e-45c7-be81-713516cb9fdf tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:46.158056 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-79571bec-e57e-45c7-be81-713516cb9fdf tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1368 microversion: 2.1 time: 0.169437 Aug 26 11:12:46.158622 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 420/861] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:45 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:47.178673 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-156cfea5-b01c-48a8-a0fb-9fee25797993 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:47.179368 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-156cfea5-b01c-48a8-a0fb-9fee25797993 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:47.189329 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-156cfea5-b01c-48a8-a0fb-9fee25797993 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:47.189887 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-156cfea5-b01c-48a8-a0fb-9fee25797993 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:47.190706 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-156cfea5-b01c-48a8-a0fb-9fee25797993 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:47.191148 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-156cfea5-b01c-48a8-a0fb-9fee25797993 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:47.191804 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-156cfea5-b01c-48a8-a0fb-9fee25797993 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:47.192457 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-156cfea5-b01c-48a8-a0fb-9fee25797993 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:47.414847 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-156cfea5-b01c-48a8-a0fb-9fee25797993 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:47.427459 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-156cfea5-b01c-48a8-a0fb-9fee25797993 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1368 microversion: 2.1 time: 0.252155 Aug 26 11:12:47.428513 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 442/862] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:47 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:48.453151 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3a91466b-4a02-42f9-9d19-69aeac1f695e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:48.453151 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3a91466b-4a02-42f9-9d19-69aeac1f695e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:48.460058 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3a91466b-4a02-42f9-9d19-69aeac1f695e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:48.460554 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3a91466b-4a02-42f9-9d19-69aeac1f695e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:48.461022 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3a91466b-4a02-42f9-9d19-69aeac1f695e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:48.461728 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3a91466b-4a02-42f9-9d19-69aeac1f695e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:48.462220 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3a91466b-4a02-42f9-9d19-69aeac1f695e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:48.462644 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3a91466b-4a02-42f9-9d19-69aeac1f695e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:48.614722 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3a91466b-4a02-42f9-9d19-69aeac1f695e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:48.624235 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3a91466b-4a02-42f9-9d19-69aeac1f695e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1368 microversion: 2.1 time: 0.175595 Aug 26 11:12:48.624820 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 421/863] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:48 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:49.647038 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-13751219-a8dd-4421-8c72-3a8ca53f0555 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:49.647879 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-13751219-a8dd-4421-8c72-3a8ca53f0555 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:49.650710 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:12:49.656537 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13751219-a8dd-4421-8c72-3a8ca53f0555 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:49.657032 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13751219-a8dd-4421-8c72-3a8ca53f0555 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:49.657471 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13751219-a8dd-4421-8c72-3a8ca53f0555 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:49.658214 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13751219-a8dd-4421-8c72-3a8ca53f0555 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:49.658672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13751219-a8dd-4421-8c72-3a8ca53f0555 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:49.659096 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-13751219-a8dd-4421-8c72-3a8ca53f0555 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:49.662971 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:12:49.839750 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-13751219-a8dd-4421-8c72-3a8ca53f0555 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:49.847979 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-13751219-a8dd-4421-8c72-3a8ca53f0555 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1368 microversion: 2.1 time: 0.206647 Aug 26 11:12:49.848747 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 443/864] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:49 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:50.870865 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5687955c-4344-4ad7-bada-35911e7148dd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:50.871506 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5687955c-4344-4ad7-bada-35911e7148dd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:50.875375 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=6 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:12:50.876204 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:12:50.881966 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5687955c-4344-4ad7-bada-35911e7148dd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:50.882471 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5687955c-4344-4ad7-bada-35911e7148dd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:50.882903 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5687955c-4344-4ad7-bada-35911e7148dd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:50.883646 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5687955c-4344-4ad7-bada-35911e7148dd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:50.884101 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5687955c-4344-4ad7-bada-35911e7148dd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:50.884521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5687955c-4344-4ad7-bada-35911e7148dd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:50.890317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:12:51.029473 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5687955c-4344-4ad7-bada-35911e7148dd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:51.036852 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5687955c-4344-4ad7-bada-35911e7148dd tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1368 microversion: 2.1 time: 0.169780 Aug 26 11:12:51.037495 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 422/865] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:50 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:12:52.058745 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-45f3fb80-548a-4422-8e60-2f6938c3e0c1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:52.060634 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-45f3fb80-548a-4422-8e60-2f6938c3e0c1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:52.062550 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:12:52.063205 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=6 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:12:52.069645 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-45f3fb80-548a-4422-8e60-2f6938c3e0c1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:52.070171 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-45f3fb80-548a-4422-8e60-2f6938c3e0c1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:52.070636 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-45f3fb80-548a-4422-8e60-2f6938c3e0c1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:52.071343 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-45f3fb80-548a-4422-8e60-2f6938c3e0c1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:52.071980 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-45f3fb80-548a-4422-8e60-2f6938c3e0c1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:52.072407 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-45f3fb80-548a-4422-8e60-2f6938c3e0c1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:52.223445 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-45f3fb80-548a-4422-8e60-2f6938c3e0c1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:52.231625 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-45f3fb80-548a-4422-8e60-2f6938c3e0c1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1368 microversion: 2.1 time: 0.176749 Aug 26 11:12:52.232715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 444/866] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:52 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:53.253470 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3d0039e4-b4e4-453b-8d76-f359d2ad6d6d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:53.254030 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3d0039e4-b4e4-453b-8d76-f359d2ad6d6d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:53.260464 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3d0039e4-b4e4-453b-8d76-f359d2ad6d6d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:53.260944 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3d0039e4-b4e4-453b-8d76-f359d2ad6d6d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:53.261377 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3d0039e4-b4e4-453b-8d76-f359d2ad6d6d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:53.262099 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3d0039e4-b4e4-453b-8d76-f359d2ad6d6d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:53.262548 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3d0039e4-b4e4-453b-8d76-f359d2ad6d6d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:53.262968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3d0039e4-b4e4-453b-8d76-f359d2ad6d6d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:53.406842 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3d0039e4-b4e4-453b-8d76-f359d2ad6d6d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:53.411420 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3d0039e4-b4e4-453b-8d76-f359d2ad6d6d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1368 microversion: 2.1 time: 0.161760 Aug 26 11:12:53.412342 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 423/867] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:53 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:53.499276 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1182583870", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452", "networks": [{"uuid": "00388d55-2f96-4066-8c5d-4eae49ca7711"}]}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:12:53.557224 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.network.neutron [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] validate_networks() for [('00388d55-2f96-4066-8c5d-4eae49ca7711', None, None, None, None, None)] {{(pid=120605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:12:53.938503 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Flavor limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:12:53.938990 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Image limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:12:53.939579 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Flavor pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:12:53.940052 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Image pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:12:53.940555 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:12:53.949886 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:53.950532 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:53.951787 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:53.953023 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:53.953544 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:53.954113 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:53.974499 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Getting quotas for project ef07a23929104d298d85485c33a0411e. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:12:53.978568 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Getting quotas for user b4ea31e78ceb46f8bc92d86211da5072 and project ef07a23929104d298d85485c33a0411e. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:12:53.991415 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Going to run 1 instances... {{(pid=120605) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:12:53.993813 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:12:54.044002 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4f052d78-1f09-4311-966c-84fdfccbd372 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549241 Aug 26 11:12:54.044949 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 445/868] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:12:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:12:54.063807 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b04d4b01-8fd1-4138-8673-cb89acfd4b9b tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:54.064680 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b04d4b01-8fd1-4138-8673-cb89acfd4b9b tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:54.130780 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b04d4b01-8fd1-4138-8673-cb89acfd4b9b tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:54.139100 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b04d4b01-8fd1-4138-8673-cb89acfd4b9b tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1214 microversion: 2.1 time: 0.085656 Aug 26 11:12:54.139822 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 424/869] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:54 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:54.259345 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-60cf00fc-3909-408d-aadb-80c248c25c61 req-9fef28ff-1d44-4ecd-894a-e5283f74d464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e78763-5fe6-49aa-9aaa-f609e352fe01", "name": "network-vif-plugged", "status": "completed", "tag": "320957d2-f8f3-4863-963f-45200e182701"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:12:54.271849 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-60cf00fc-3909-408d-aadb-80c248c25c61 req-9fef28ff-1d44-4ecd-894a-e5283f74d464 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:54.272336 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-60cf00fc-3909-408d-aadb-80c248c25c61 req-9fef28ff-1d44-4ecd-894a-e5283f74d464 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:54.272934 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-60cf00fc-3909-408d-aadb-80c248c25c61 req-9fef28ff-1d44-4ecd-894a-e5283f74d464 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:54.286915 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-60cf00fc-3909-408d-aadb-80c248c25c61 req-9fef28ff-1d44-4ecd-894a-e5283f74d464 service nova] Creating event network-vif-plugged:320957d2-f8f3-4863-963f-45200e182701 for instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 on hv-cinder-85236 Aug 26 11:12:54.293330 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-60cf00fc-3909-408d-aadb-80c248c25c61 req-9fef28ff-1d44-4ecd-894a-e5283f74d464 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038057 Aug 26 11:12:54.293930 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 446/870] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:12:54.434500 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-23913358-005d-4258-8141-7611e2389ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:54.435312 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-23913358-005d-4258-8141-7611e2389ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:54.443323 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23913358-005d-4258-8141-7611e2389ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:54.443937 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23913358-005d-4258-8141-7611e2389ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:54.444708 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23913358-005d-4258-8141-7611e2389ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:54.445425 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23913358-005d-4258-8141-7611e2389ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:54.446143 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23913358-005d-4258-8141-7611e2389ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:54.446724 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23913358-005d-4258-8141-7611e2389ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:54.647006 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-23913358-005d-4258-8141-7611e2389ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:54.655135 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-23913358-005d-4258-8141-7611e2389ff2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1368 microversion: 2.1 time: 0.224815 Aug 26 11:12:54.655704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 425/871] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:54 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:55.160779 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-db172f84-03f7-4475-8443-a3447375cd12 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:55.161487 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-db172f84-03f7-4475-8443-a3447375cd12 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:55.167601 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db172f84-03f7-4475-8443-a3447375cd12 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:55.168079 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db172f84-03f7-4475-8443-a3447375cd12 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:55.168513 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db172f84-03f7-4475-8443-a3447375cd12 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:55.169205 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db172f84-03f7-4475-8443-a3447375cd12 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:55.170544 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db172f84-03f7-4475-8443-a3447375cd12 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:55.170881 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db172f84-03f7-4475-8443-a3447375cd12 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:55.236866 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-db172f84-03f7-4475-8443-a3447375cd12 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:55.244612 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-db172f84-03f7-4475-8443-a3447375cd12 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1266 microversion: 2.1 time: 0.088554 Aug 26 11:12:55.245175 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 447/872] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:55 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:55.676695 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0b2b8f69-8157-439e-823a-4a5a1537078e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:55.677208 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0b2b8f69-8157-439e-823a-4a5a1537078e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:55.683432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0b2b8f69-8157-439e-823a-4a5a1537078e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:55.683940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0b2b8f69-8157-439e-823a-4a5a1537078e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:55.684373 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0b2b8f69-8157-439e-823a-4a5a1537078e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:55.685125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0b2b8f69-8157-439e-823a-4a5a1537078e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:55.685659 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0b2b8f69-8157-439e-823a-4a5a1537078e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:55.686108 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0b2b8f69-8157-439e-823a-4a5a1537078e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:55.820631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0b2b8f69-8157-439e-823a-4a5a1537078e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:55.829855 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0b2b8f69-8157-439e-823a-4a5a1537078e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1368 microversion: 2.1 time: 0.157133 Aug 26 11:12:55.842252 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 426/873] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:55 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:56.267264 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-fe9d06de-824e-4ddd-93e7-f00cd9c2fa74 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:56.268470 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-fe9d06de-824e-4ddd-93e7-f00cd9c2fa74 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:56.275576 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fe9d06de-824e-4ddd-93e7-f00cd9c2fa74 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:56.276214 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fe9d06de-824e-4ddd-93e7-f00cd9c2fa74 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:56.276629 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fe9d06de-824e-4ddd-93e7-f00cd9c2fa74 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:56.277693 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fe9d06de-824e-4ddd-93e7-f00cd9c2fa74 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:56.278365 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fe9d06de-824e-4ddd-93e7-f00cd9c2fa74 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:56.279555 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fe9d06de-824e-4ddd-93e7-f00cd9c2fa74 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:56.617186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-fe9d06de-824e-4ddd-93e7-f00cd9c2fa74 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:56.627903 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-fe9d06de-824e-4ddd-93e7-f00cd9c2fa74 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1274 microversion: 2.1 time: 0.364811 Aug 26 11:12:56.628510 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 448/874] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:56 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1274 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:12:56.852604 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4814001f-096f-4cc7-a283-db905834eb85 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:56.853430 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4814001f-096f-4cc7-a283-db905834eb85 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:56.871218 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4814001f-096f-4cc7-a283-db905834eb85 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:56.871771 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4814001f-096f-4cc7-a283-db905834eb85 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:56.872169 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4814001f-096f-4cc7-a283-db905834eb85 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:56.873959 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4814001f-096f-4cc7-a283-db905834eb85 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:56.873959 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4814001f-096f-4cc7-a283-db905834eb85 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:56.874349 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4814001f-096f-4cc7-a283-db905834eb85 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:57.105154 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4814001f-096f-4cc7-a283-db905834eb85 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:57.114297 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4814001f-096f-4cc7-a283-db905834eb85 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1557 microversion: 2.1 time: 0.265466 Aug 26 11:12:57.122097 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 427/875] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:56 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1557 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:57.142022 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-89b8fb67-c966-4346-bc6b-820bb1a2ed1f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:57.143077 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-89b8fb67-c966-4346-bc6b-820bb1a2ed1f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:57.149668 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-89b8fb67-c966-4346-bc6b-820bb1a2ed1f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:57.150426 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-89b8fb67-c966-4346-bc6b-820bb1a2ed1f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:57.150877 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-89b8fb67-c966-4346-bc6b-820bb1a2ed1f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:57.151822 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-89b8fb67-c966-4346-bc6b-820bb1a2ed1f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:57.152289 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-89b8fb67-c966-4346-bc6b-820bb1a2ed1f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:57.152752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-89b8fb67-c966-4346-bc6b-820bb1a2ed1f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:57.271660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-89b8fb67-c966-4346-bc6b-820bb1a2ed1f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134954 Aug 26 11:12:57.272252 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 449/876] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 26 11:12:57 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:12:57.650960 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0f3b741f-e64e-41ad-bcce-ea86381115b4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:57.651969 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0f3b741f-e64e-41ad-bcce-ea86381115b4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:57.660221 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0f3b741f-e64e-41ad-bcce-ea86381115b4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:57.661089 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0f3b741f-e64e-41ad-bcce-ea86381115b4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:57.661795 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0f3b741f-e64e-41ad-bcce-ea86381115b4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:57.662768 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0f3b741f-e64e-41ad-bcce-ea86381115b4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:57.663482 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0f3b741f-e64e-41ad-bcce-ea86381115b4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:57.664061 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0f3b741f-e64e-41ad-bcce-ea86381115b4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:57.979188 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0f3b741f-e64e-41ad-bcce-ea86381115b4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:57.988272 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0f3b741f-e64e-41ad-bcce-ea86381115b4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1314 microversion: 2.1 time: 0.341900 Aug 26 11:12:57.988848 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 428/877] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:57 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:58.104361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-fbd92f25-7952-4efd-9d60-d553b263e645 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:58.104857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-fbd92f25-7952-4efd-9d60-d553b263e645 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:58.111576 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fbd92f25-7952-4efd-9d60-d553b263e645 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:58.112061 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fbd92f25-7952-4efd-9d60-d553b263e645 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:58.112490 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fbd92f25-7952-4efd-9d60-d553b263e645 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:58.113183 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fbd92f25-7952-4efd-9d60-d553b263e645 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:58.113631 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fbd92f25-7952-4efd-9d60-d553b263e645 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:58.114069 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fbd92f25-7952-4efd-9d60-d553b263e645 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:58.143867 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-fbd92f25-7952-4efd-9d60-d553b263e645 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Going to try to terminate instance {{(pid=120605) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:12:58.254409 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-fbd92f25-7952-4efd-9d60-d553b263e645 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 204 len: 0 microversion: 2.1 time: 0.154217 Aug 26 11:12:58.255091 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 450/878] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:12:58 2022] DELETE /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:12:58.265765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3f48ae67-23ef-4aa6-91e1-98e1991f3f55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:58.266541 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3f48ae67-23ef-4aa6-91e1-98e1991f3f55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:58.273219 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f48ae67-23ef-4aa6-91e1-98e1991f3f55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:58.273710 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f48ae67-23ef-4aa6-91e1-98e1991f3f55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:58.274173 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f48ae67-23ef-4aa6-91e1-98e1991f3f55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:58.275151 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f48ae67-23ef-4aa6-91e1-98e1991f3f55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:58.275846 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f48ae67-23ef-4aa6-91e1-98e1991f3f55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:58.276410 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f48ae67-23ef-4aa6-91e1-98e1991f3f55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:58.392452 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-dd98e61e-7a69-4ccf-9215-0386f242632c req-8c94a75b-c79c-4b71-b720-aa5cf0a200f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93ee60f8-1765-4fa7-911e-bba285cfd593", "tag": "17d5fa78-5e85-42fc-a522-13a7d91a2705"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:12:58.409260 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-dd98e61e-7a69-4ccf-9215-0386f242632c req-8c94a75b-c79c-4b71-b720-aa5cf0a200f7 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:58.411720 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-dd98e61e-7a69-4ccf-9215-0386f242632c req-8c94a75b-c79c-4b71-b720-aa5cf0a200f7 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:58.412729 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-dd98e61e-7a69-4ccf-9215-0386f242632c req-8c94a75b-c79c-4b71-b720-aa5cf0a200f7 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:58.432987 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-dd98e61e-7a69-4ccf-9215-0386f242632c req-8c94a75b-c79c-4b71-b720-aa5cf0a200f7 service nova] Creating event network-changed:17d5fa78-5e85-42fc-a522-13a7d91a2705 for instance 93ee60f8-1765-4fa7-911e-bba285cfd593 on hv-cinder-85236 Aug 26 11:12:58.442589 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-dd98e61e-7a69-4ccf-9215-0386f242632c req-8c94a75b-c79c-4b71-b720-aa5cf0a200f7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056338 Aug 26 11:12:58.443988 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 451/879] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:12:58.505257 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3f48ae67-23ef-4aa6-91e1-98e1991f3f55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:58.515514 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3f48ae67-23ef-4aa6-91e1-98e1991f3f55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1577 microversion: 2.1 time: 0.255653 Aug 26 11:12:58.516302 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 429/880] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:58 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1577 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:12:58.718888 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-f0afb261-2bd0-4913-bd56-fd5717f7035b req-2b1c695b-5c3c-49a4-8fc4-1cbb8c2d7248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0e78763-5fe6-49aa-9aaa-f609e352fe01", "tag": "320957d2-f8f3-4863-963f-45200e182701"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:12:58.728724 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f0afb261-2bd0-4913-bd56-fd5717f7035b req-2b1c695b-5c3c-49a4-8fc4-1cbb8c2d7248 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:58.729200 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f0afb261-2bd0-4913-bd56-fd5717f7035b req-2b1c695b-5c3c-49a4-8fc4-1cbb8c2d7248 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:58.729625 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f0afb261-2bd0-4913-bd56-fd5717f7035b req-2b1c695b-5c3c-49a4-8fc4-1cbb8c2d7248 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:58.741889 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-f0afb261-2bd0-4913-bd56-fd5717f7035b req-2b1c695b-5c3c-49a4-8fc4-1cbb8c2d7248 service nova] Creating event network-changed:320957d2-f8f3-4863-963f-45200e182701 for instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 on hv-cinder-85236 Aug 26 11:12:58.749195 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-f0afb261-2bd0-4913-bd56-fd5717f7035b req-2b1c695b-5c3c-49a4-8fc4-1cbb8c2d7248 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033318 Aug 26 11:12:58.749963 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 452/881] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:12:59.012813 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7bc7a64d-026a-426f-a616-29310cab2fec tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:59.014037 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7bc7a64d-026a-426f-a616-29310cab2fec tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:59.020690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7bc7a64d-026a-426f-a616-29310cab2fec tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:59.021176 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7bc7a64d-026a-426f-a616-29310cab2fec tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:59.022163 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7bc7a64d-026a-426f-a616-29310cab2fec tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:59.022970 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7bc7a64d-026a-426f-a616-29310cab2fec tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:59.023477 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7bc7a64d-026a-426f-a616-29310cab2fec tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:59.023897 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7bc7a64d-026a-426f-a616-29310cab2fec tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:59.179939 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7bc7a64d-026a-426f-a616-29310cab2fec tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:59.188901 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7bc7a64d-026a-426f-a616-29310cab2fec tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1314 microversion: 2.1 time: 0.180242 Aug 26 11:12:59.190274 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 430/882] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:59 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:12:59.556444 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f37faf61-e0b5-4b92-b7fe-dd63f16c9737 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:12:59.558333 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f37faf61-e0b5-4b92-b7fe-dd63f16c9737 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:12:59.579746 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f37faf61-e0b5-4b92-b7fe-dd63f16c9737 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:59.583246 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f37faf61-e0b5-4b92-b7fe-dd63f16c9737 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:59.583795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f37faf61-e0b5-4b92-b7fe-dd63f16c9737 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:59.584818 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f37faf61-e0b5-4b92-b7fe-dd63f16c9737 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:12:59.585426 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f37faf61-e0b5-4b92-b7fe-dd63f16c9737 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:12:59.585853 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f37faf61-e0b5-4b92-b7fe-dd63f16c9737 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:12:59.869128 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f37faf61-e0b5-4b92-b7fe-dd63f16c9737 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:12:59.882775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f37faf61-e0b5-4b92-b7fe-dd63f16c9737 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1577 microversion: 2.1 time: 0.347743 Aug 26 11:12:59.883358 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 453/883] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:12:59 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1577 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:00.212767 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-77e59964-0df5-4d8e-8d9e-0888403ab0eb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:00.213433 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-77e59964-0df5-4d8e-8d9e-0888403ab0eb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:00.221200 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-77e59964-0df5-4d8e-8d9e-0888403ab0eb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:00.221777 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-77e59964-0df5-4d8e-8d9e-0888403ab0eb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:00.222333 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-77e59964-0df5-4d8e-8d9e-0888403ab0eb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:00.223041 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-77e59964-0df5-4d8e-8d9e-0888403ab0eb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:00.223490 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-77e59964-0df5-4d8e-8d9e-0888403ab0eb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:00.223908 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-77e59964-0df5-4d8e-8d9e-0888403ab0eb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:00.431741 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-77e59964-0df5-4d8e-8d9e-0888403ab0eb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:00.441169 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-77e59964-0df5-4d8e-8d9e-0888403ab0eb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1314 microversion: 2.1 time: 0.232800 Aug 26 11:13:00.447478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 431/884] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:00 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:00.905869 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-cd5951d6-df5f-473b-98f4-146ecff40fd2 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:00.907137 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-cd5951d6-df5f-473b-98f4-146ecff40fd2 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:00.913918 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd5951d6-df5f-473b-98f4-146ecff40fd2 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:00.914452 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd5951d6-df5f-473b-98f4-146ecff40fd2 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:00.914883 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd5951d6-df5f-473b-98f4-146ecff40fd2 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:00.915582 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd5951d6-df5f-473b-98f4-146ecff40fd2 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:00.916027 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd5951d6-df5f-473b-98f4-146ecff40fd2 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:00.916447 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-cd5951d6-df5f-473b-98f4-146ecff40fd2 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:00.983829 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-cd5951d6-df5f-473b-98f4-146ecff40fd2 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:00.991723 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-cd5951d6-df5f-473b-98f4-146ecff40fd2 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1509 microversion: 2.1 time: 0.090948 Aug 26 11:13:00.992296 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 454/885] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:00 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1509 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:01.152207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-91f3a60f-4c12-4cf2-a535-82d1856c2612 req-67080a7d-a34a-406d-88dd-360f33024a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e7d29e-0b68-4fea-9855-e1250c542c1b", "name": "network-vif-deleted", "tag": "3ad3e811-600f-48c6-90d1-8ccbd04adc1c"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:13:01.163046 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-91f3a60f-4c12-4cf2-a535-82d1856c2612 req-67080a7d-a34a-406d-88dd-360f33024a31 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:01.163510 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-91f3a60f-4c12-4cf2-a535-82d1856c2612 req-67080a7d-a34a-406d-88dd-360f33024a31 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:01.163936 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-91f3a60f-4c12-4cf2-a535-82d1856c2612 req-67080a7d-a34a-406d-88dd-360f33024a31 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:01.175526 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-91f3a60f-4c12-4cf2-a535-82d1856c2612 req-67080a7d-a34a-406d-88dd-360f33024a31 service nova] Creating event network-vif-deleted:3ad3e811-600f-48c6-90d1-8ccbd04adc1c for instance d5e7d29e-0b68-4fea-9855-e1250c542c1b on hv-cinder-85236 Aug 26 11:13:01.181029 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-91f3a60f-4c12-4cf2-a535-82d1856c2612 req-67080a7d-a34a-406d-88dd-360f33024a31 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032472 Aug 26 11:13:01.181625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 432/886] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:13:01.462789 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-79a9de4c-246b-49cd-bdf8-d9908a667cb0 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:01.463401 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-79a9de4c-246b-49cd-bdf8-d9908a667cb0 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:01.470759 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-79a9de4c-246b-49cd-bdf8-d9908a667cb0 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:01.471250 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-79a9de4c-246b-49cd-bdf8-d9908a667cb0 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:01.471688 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-79a9de4c-246b-49cd-bdf8-d9908a667cb0 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:01.472388 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-79a9de4c-246b-49cd-bdf8-d9908a667cb0 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:01.472835 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-79a9de4c-246b-49cd-bdf8-d9908a667cb0 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:01.473253 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-79a9de4c-246b-49cd-bdf8-d9908a667cb0 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:01.609914 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-79a9de4c-246b-49cd-bdf8-d9908a667cb0 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:01.617731 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-79a9de4c-246b-49cd-bdf8-d9908a667cb0 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1314 microversion: 2.1 time: 0.158845 Aug 26 11:13:01.618349 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 455/887] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:01 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:02.015386 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e63dfbc4-1d64-4f82-bba0-4dd0944492cd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:02.016589 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e63dfbc4-1d64-4f82-bba0-4dd0944492cd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:02.023290 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e63dfbc4-1d64-4f82-bba0-4dd0944492cd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:02.023776 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e63dfbc4-1d64-4f82-bba0-4dd0944492cd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:02.024223 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e63dfbc4-1d64-4f82-bba0-4dd0944492cd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:02.025024 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e63dfbc4-1d64-4f82-bba0-4dd0944492cd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:02.025482 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e63dfbc4-1d64-4f82-bba0-4dd0944492cd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:02.025909 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e63dfbc4-1d64-4f82-bba0-4dd0944492cd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:02.089289 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e63dfbc4-1d64-4f82-bba0-4dd0944492cd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:02.097836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e63dfbc4-1d64-4f82-bba0-4dd0944492cd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1509 microversion: 2.1 time: 0.087415 Aug 26 11:13:02.098538 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 433/888] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:02 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1509 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:02.641014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a365fd9f-353e-466c-b47c-54cd038cfc3a tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:02.641622 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-a365fd9f-353e-466c-b47c-54cd038cfc3a tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:02.648082 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a365fd9f-353e-466c-b47c-54cd038cfc3a tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:02.648559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a365fd9f-353e-466c-b47c-54cd038cfc3a tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:02.648985 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a365fd9f-353e-466c-b47c-54cd038cfc3a tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:02.649705 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a365fd9f-353e-466c-b47c-54cd038cfc3a tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:02.650176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a365fd9f-353e-466c-b47c-54cd038cfc3a tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:02.650597 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a365fd9f-353e-466c-b47c-54cd038cfc3a tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:02.788087 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-a365fd9f-353e-466c-b47c-54cd038cfc3a tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:02.796688 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-a365fd9f-353e-466c-b47c-54cd038cfc3a tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1314 microversion: 2.1 time: 0.160756 Aug 26 11:13:02.797288 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 456/889] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:02 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:03.126922 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-588d530b-3b16-4542-858d-a6bb84a456b3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:03.127563 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-588d530b-3b16-4542-858d-a6bb84a456b3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:03.134109 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-588d530b-3b16-4542-858d-a6bb84a456b3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:03.134594 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-588d530b-3b16-4542-858d-a6bb84a456b3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:03.135026 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-588d530b-3b16-4542-858d-a6bb84a456b3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:03.135723 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-588d530b-3b16-4542-858d-a6bb84a456b3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:03.136172 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-588d530b-3b16-4542-858d-a6bb84a456b3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:03.136591 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-588d530b-3b16-4542-858d-a6bb84a456b3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:03.199522 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-588d530b-3b16-4542-858d-a6bb84a456b3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:03.207212 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-588d530b-3b16-4542-858d-a6bb84a456b3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1509 microversion: 2.1 time: 0.087290 Aug 26 11:13:03.207781 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 434/890] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:03 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1509 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:03.817265 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-2706ead0-1c3c-485d-a585-71e699899d31 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:03.817876 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-2706ead0-1c3c-485d-a585-71e699899d31 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:03.824437 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2706ead0-1c3c-485d-a585-71e699899d31 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:03.824926 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2706ead0-1c3c-485d-a585-71e699899d31 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:03.825365 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2706ead0-1c3c-485d-a585-71e699899d31 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:03.826127 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2706ead0-1c3c-485d-a585-71e699899d31 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:03.826580 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2706ead0-1c3c-485d-a585-71e699899d31 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:03.827008 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2706ead0-1c3c-485d-a585-71e699899d31 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:03.962771 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:03.977218 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-2706ead0-1c3c-485d-a585-71e699899d31 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:03.986433 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=6 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:03.990133 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-2706ead0-1c3c-485d-a585-71e699899d31 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1314 microversion: 2.1 time: 0.176597 Aug 26 11:13:03.993223 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 457/891] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:03 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:04.233750 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-aa908eee-434b-4b7b-9e48-77c297715d9c tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:04.234912 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-aa908eee-434b-4b7b-9e48-77c297715d9c tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:04.241431 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:04.245408 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aa908eee-434b-4b7b-9e48-77c297715d9c tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:04.245952 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aa908eee-434b-4b7b-9e48-77c297715d9c tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:04.246467 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aa908eee-434b-4b7b-9e48-77c297715d9c tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:04.247434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aa908eee-434b-4b7b-9e48-77c297715d9c tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:04.248561 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aa908eee-434b-4b7b-9e48-77c297715d9c tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:04.249279 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aa908eee-434b-4b7b-9e48-77c297715d9c tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:04.336176 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-aa908eee-434b-4b7b-9e48-77c297715d9c tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:04.345388 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-aa908eee-434b-4b7b-9e48-77c297715d9c tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 200 len: 1224 microversion: 2.1 time: 0.119475 Aug 26 11:13:04.346240 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 435/892] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:04 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 1224 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:05.019865 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4500004c-8160-4c90-9097-a531b338db2b tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:05.020582 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4500004c-8160-4c90-9097-a531b338db2b tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:05.027240 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4500004c-8160-4c90-9097-a531b338db2b tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:05.027725 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4500004c-8160-4c90-9097-a531b338db2b tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:05.028154 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4500004c-8160-4c90-9097-a531b338db2b tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:05.028961 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4500004c-8160-4c90-9097-a531b338db2b tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:05.029412 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4500004c-8160-4c90-9097-a531b338db2b tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:05.029831 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4500004c-8160-4c90-9097-a531b338db2b tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:05.183521 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4500004c-8160-4c90-9097-a531b338db2b tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:05.192215 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4500004c-8160-4c90-9097-a531b338db2b tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1314 microversion: 2.1 time: 0.176267 Aug 26 11:13:05.192802 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 458/893] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:05 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:05.368756 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-40e0b9c1-0005-4adb-86db-e9aea8dcef71 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:05.369364 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-40e0b9c1-0005-4adb-86db-e9aea8dcef71 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:05.376834 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-40e0b9c1-0005-4adb-86db-e9aea8dcef71 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:05.377317 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-40e0b9c1-0005-4adb-86db-e9aea8dcef71 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:05.377751 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-40e0b9c1-0005-4adb-86db-e9aea8dcef71 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:05.378494 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-40e0b9c1-0005-4adb-86db-e9aea8dcef71 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:05.378942 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-40e0b9c1-0005-4adb-86db-e9aea8dcef71 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:05.379365 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-40e0b9c1-0005-4adb-86db-e9aea8dcef71 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:05.396433 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-40e0b9c1-0005-4adb-86db-e9aea8dcef71 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] HTTP exception thrown: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-40e0b9c1-0005-4adb-86db-e9aea8dcef71 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Request method failure captured: Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b HTTP/1.1 Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKoH_-LbA9Rbs23oPrkIgCJE5CpgrKujLryDaAPkgg-OKVNJ7DV6wIiWdEEQ6XU-hsuyBzbTQd-4sDVZz9GxogqNH8VUw6N0KKu6dIweFRnG8ToTD8dkxqr8MbxvWVIVjUKQeUZkZMui7Knu2AfJ8oYCS5c0u4zXtOpu160VKpbq5mg Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: d773f20240a44729b159c57c80e017ef Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-TestVolumeBootPattern-609580237 Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:13:05.398034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:13:05.399527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d773f20240a44729b159c57c80e017ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d773f20240a44729b159c57c80e017ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d773f20240a44729b159c57c80e017ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d773f20240a44729b159c57c80e017ef"}]}] Aug 26 11:13:05.399527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-TestVolumeBootPattern-609580237 Aug 26 11:13:05.399527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: d773f20240a44729b159c57c80e017ef Aug 26 11:13:05.399527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-TestVolumeBootPattern-609580237 Aug 26 11:13:05.399527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-TestVolumeBootPattern-609580237-project Aug 26 11:13:05.399527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:13:05.399527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:13:05.399527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 9e8355dc324e49d881b9f0fc5c2923ad Aug 26 11:13:05.399527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-TestVolumeBootPattern-609580237-project Aug 26 11:13:05.399527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:13:05.399527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. Aug 26 11:13:05.399527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'd5e7d29e-0b68-4fea-9855-e1250c542c1b'} Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:13:05.400382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. Aug 26 11:13:05.401935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:05.403322 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-40e0b9c1-0005-4adb-86db-e9aea8dcef71 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Returning 404 to user: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:13:05.403322 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-40e0b9c1-0005-4adb-86db-e9aea8dcef71 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 404 len: 111 microversion: 2.1 time: 0.034577 Aug 26 11:13:05.403322 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 436/894] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:05 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:13:05.508955 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1298340755", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-246835179", "security_groups": [{"name": "tempest-secgroup-smoke-1665899742"}], "block_device_mapping_v2": [{"uuid": "2613a319-9616-4e52-9655-fe01c5d0d60d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bdfdb3db-3bbb-431b-99cd-605e0811c994"}]}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:13:05.636086 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.network.neutron [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] validate_networks() for [('bdfdb3db-3bbb-431b-99cd-605e0811c994', None, None, None, None, None)] {{(pid=120605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:13:06.051803 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Flavor limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:13:06.052299 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Image limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:13:06.052759 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Flavor pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:13:06.053232 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Image pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:13:06.053609 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:13:06.063574 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:06.064059 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:06.064503 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:06.065228 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:06.065681 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:06.066130 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:06.086705 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Getting quotas for project d773f20240a44729b159c57c80e017ef. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:13:06.093441 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Getting quotas for user 9e8355dc324e49d881b9f0fc5c2923ad and project d773f20240a44729b159c57c80e017ef. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:13:06.159244 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Going to run 1 instances... {{(pid=120605) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:13:06.161352 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2613a319-9616-4e52-9655-fe01c5d0d60d',volume_size=None,volume_type=None)] {{(pid=120605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:13:06.214960 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8e7ec708-830a-4292-814f-792236c3bf23 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:06.215691 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8e7ec708-830a-4292-814f-792236c3bf23 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:06.222510 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8e7ec708-830a-4292-814f-792236c3bf23 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:06.223197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8e7ec708-830a-4292-814f-792236c3bf23 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:06.223686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8e7ec708-830a-4292-814f-792236c3bf23 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:06.224476 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8e7ec708-830a-4292-814f-792236c3bf23 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:06.224983 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8e7ec708-830a-4292-814f-792236c3bf23 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:06.225570 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8e7ec708-830a-4292-814f-792236c3bf23 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:06.320517 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-7b38475d-d97d-4788-ab31-3d5a5c5000b8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.817718 Aug 26 11:13:06.321475 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 459/895] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:13:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:13:06.332899 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-7a401d52-8735-4458-b0e2-bb53aaa6d626 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:06.333505 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-7a401d52-8735-4458-b0e2-bb53aaa6d626 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:06.415909 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7a401d52-8735-4458-b0e2-bb53aaa6d626 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:06.421553 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8e7ec708-830a-4292-814f-792236c3bf23 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:06.428672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-7a401d52-8735-4458-b0e2-bb53aaa6d626 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1094 microversion: 2.1 time: 0.099504 Aug 26 11:13:06.429416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 460/896] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:06 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1094 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:13:06.439588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8e7ec708-830a-4292-814f-792236c3bf23 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1314 microversion: 2.1 time: 0.228935 Aug 26 11:13:06.440450 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 437/897] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:06 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:07.451990 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-fbd4bfeb-9129-4ba9-a3ee-5fddb80d1409 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:07.452778 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-fbd4bfeb-9129-4ba9-a3ee-5fddb80d1409 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:07.460112 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fbd4bfeb-9129-4ba9-a3ee-5fddb80d1409 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:07.460985 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fbd4bfeb-9129-4ba9-a3ee-5fddb80d1409 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:07.461641 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fbd4bfeb-9129-4ba9-a3ee-5fddb80d1409 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:07.462669 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fbd4bfeb-9129-4ba9-a3ee-5fddb80d1409 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:07.463322 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fbd4bfeb-9129-4ba9-a3ee-5fddb80d1409 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:07.463448 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d78275b6-d31c-461f-ab54-9c96e8b2dcaa tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:07.464246 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d78275b6-d31c-461f-ab54-9c96e8b2dcaa tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:07.464650 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fbd4bfeb-9129-4ba9-a3ee-5fddb80d1409 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:07.471233 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d78275b6-d31c-461f-ab54-9c96e8b2dcaa tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:07.472337 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d78275b6-d31c-461f-ab54-9c96e8b2dcaa tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:07.472819 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d78275b6-d31c-461f-ab54-9c96e8b2dcaa tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:07.473666 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d78275b6-d31c-461f-ab54-9c96e8b2dcaa tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:07.474335 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d78275b6-d31c-461f-ab54-9c96e8b2dcaa tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:07.474842 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d78275b6-d31c-461f-ab54-9c96e8b2dcaa tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:07.542652 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-fbd4bfeb-9129-4ba9-a3ee-5fddb80d1409 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:07.557502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-fbd4bfeb-9129-4ba9-a3ee-5fddb80d1409 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1192 microversion: 2.1 time: 0.109839 Aug 26 11:13:07.571863 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 461/898] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:07 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1192 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:07.736269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d78275b6-d31c-461f-ab54-9c96e8b2dcaa tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:07.746219 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d78275b6-d31c-461f-ab54-9c96e8b2dcaa tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1314 microversion: 2.1 time: 0.288000 Aug 26 11:13:07.747049 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 438/899] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:07 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:13:08.586207 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c3c22cc1-5ba7-4cf1-86b1-8679bce5c3dd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:08.587035 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c3c22cc1-5ba7-4cf1-86b1-8679bce5c3dd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:08.599147 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c3c22cc1-5ba7-4cf1-86b1-8679bce5c3dd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:08.604907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c3c22cc1-5ba7-4cf1-86b1-8679bce5c3dd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:08.605646 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c3c22cc1-5ba7-4cf1-86b1-8679bce5c3dd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:08.607434 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c3c22cc1-5ba7-4cf1-86b1-8679bce5c3dd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:08.608308 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c3c22cc1-5ba7-4cf1-86b1-8679bce5c3dd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:08.608908 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c3c22cc1-5ba7-4cf1-86b1-8679bce5c3dd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:08.772390 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-de1091e3-6f50-4bbd-ac43-9470a7112590 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:08.774378 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-de1091e3-6f50-4bbd-ac43-9470a7112590 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:08.783694 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de1091e3-6f50-4bbd-ac43-9470a7112590 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:08.784727 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de1091e3-6f50-4bbd-ac43-9470a7112590 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:08.785398 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de1091e3-6f50-4bbd-ac43-9470a7112590 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:08.786557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de1091e3-6f50-4bbd-ac43-9470a7112590 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:08.787210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de1091e3-6f50-4bbd-ac43-9470a7112590 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:08.787847 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de1091e3-6f50-4bbd-ac43-9470a7112590 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:08.808997 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c3c22cc1-5ba7-4cf1-86b1-8679bce5c3dd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:08.815863 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:08.824696 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c3c22cc1-5ba7-4cf1-86b1-8679bce5c3dd tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1278 microversion: 2.1 time: 0.244345 Aug 26 11:13:08.832414 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 462/900] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:08 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:08.980182 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-de1091e3-6f50-4bbd-ac43-9470a7112590 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:08.988857 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-de1091e3-6f50-4bbd-ac43-9470a7112590 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1314 microversion: 2.1 time: 0.222647 Aug 26 11:13:08.989770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 439/901] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:08 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:13:09.345131 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-4557f03f-9590-4b91-9ad3-7fdea974ad97 req-87ca51ac-b6cc-4fc6-885b-8c7024cef6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e72f32-b26f-4799-b3c9-dd6352d5c100", "tag": "202f8947-cca0-41bf-9a36-01029ac31a92"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:13:09.355998 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-4557f03f-9590-4b91-9ad3-7fdea974ad97 req-87ca51ac-b6cc-4fc6-885b-8c7024cef6d4 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:09.356828 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-4557f03f-9590-4b91-9ad3-7fdea974ad97 req-87ca51ac-b6cc-4fc6-885b-8c7024cef6d4 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:09.357878 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-4557f03f-9590-4b91-9ad3-7fdea974ad97 req-87ca51ac-b6cc-4fc6-885b-8c7024cef6d4 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:09.377340 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-4557f03f-9590-4b91-9ad3-7fdea974ad97 req-87ca51ac-b6cc-4fc6-885b-8c7024cef6d4 service nova] Creating event network-changed:202f8947-cca0-41bf-9a36-01029ac31a92 for instance c8e72f32-b26f-4799-b3c9-dd6352d5c100 on hv-cinder-85236 Aug 26 11:13:09.382368 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-4557f03f-9590-4b91-9ad3-7fdea974ad97 req-87ca51ac-b6cc-4fc6-885b-8c7024cef6d4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041133 Aug 26 11:13:09.383253 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 463/902] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:13:09.851140 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-78576cde-6a48-4607-9af2-72492bb72cbc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:09.851863 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-78576cde-6a48-4607-9af2-72492bb72cbc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:09.868068 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-78576cde-6a48-4607-9af2-72492bb72cbc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:09.868451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-78576cde-6a48-4607-9af2-72492bb72cbc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:09.868961 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-78576cde-6a48-4607-9af2-72492bb72cbc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:09.870237 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-78576cde-6a48-4607-9af2-72492bb72cbc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:09.870773 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-78576cde-6a48-4607-9af2-72492bb72cbc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:09.871570 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-78576cde-6a48-4607-9af2-72492bb72cbc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:09.973244 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-c1160d13-5035-4ef7-8f4d-b8750299571f req-5917dc97-9253-4eea-998a-e820a5a46005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93ee60f8-1765-4fa7-911e-bba285cfd593", "name": "network-vif-plugged", "status": "completed", "tag": "17d5fa78-5e85-42fc-a522-13a7d91a2705"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:13:09.985223 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-c1160d13-5035-4ef7-8f4d-b8750299571f req-5917dc97-9253-4eea-998a-e820a5a46005 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:09.985694 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-c1160d13-5035-4ef7-8f4d-b8750299571f req-5917dc97-9253-4eea-998a-e820a5a46005 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:09.986329 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-c1160d13-5035-4ef7-8f4d-b8750299571f req-5917dc97-9253-4eea-998a-e820a5a46005 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:10.004410 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-c1160d13-5035-4ef7-8f4d-b8750299571f req-5917dc97-9253-4eea-998a-e820a5a46005 service nova] Creating event network-vif-plugged:17d5fa78-5e85-42fc-a522-13a7d91a2705 for instance 93ee60f8-1765-4fa7-911e-bba285cfd593 on hv-cinder-85236 Aug 26 11:13:10.011563 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-c1160d13-5035-4ef7-8f4d-b8750299571f req-5917dc97-9253-4eea-998a-e820a5a46005 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043652 Aug 26 11:13:10.012709 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 464/903] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:13:10.020251 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f95fb1f5-dbb3-4ae1-942e-0a947a87de53 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:10.021744 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f95fb1f5-dbb3-4ae1-942e-0a947a87de53 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:10.029901 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f95fb1f5-dbb3-4ae1-942e-0a947a87de53 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:10.030780 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f95fb1f5-dbb3-4ae1-942e-0a947a87de53 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:10.031407 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f95fb1f5-dbb3-4ae1-942e-0a947a87de53 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:10.032193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f95fb1f5-dbb3-4ae1-942e-0a947a87de53 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:10.032819 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f95fb1f5-dbb3-4ae1-942e-0a947a87de53 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:10.033411 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f95fb1f5-dbb3-4ae1-942e-0a947a87de53 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:10.056190 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-78576cde-6a48-4607-9af2-72492bb72cbc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:10.076507 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-78576cde-6a48-4607-9af2-72492bb72cbc tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1266 microversion: 2.1 time: 0.228684 Aug 26 11:13:10.077769 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 440/904] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:09 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:10.212744 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f95fb1f5-dbb3-4ae1-942e-0a947a87de53 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:10.222451 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f95fb1f5-dbb3-4ae1-942e-0a947a87de53 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1314 microversion: 2.1 time: 0.206922 Aug 26 11:13:10.226732 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 465/905] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:10 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:11.099285 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1dc41cd2-eac1-41eb-a85a-23d98d6e486b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:11.100064 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1dc41cd2-eac1-41eb-a85a-23d98d6e486b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:11.103995 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 11:13:11.104154 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Fri Aug 26 11:13:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 (ip 10.222.0.40) !!! Aug 26 11:13:11.118063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1dc41cd2-eac1-41eb-a85a-23d98d6e486b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:11.118722 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1dc41cd2-eac1-41eb-a85a-23d98d6e486b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:11.119159 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1dc41cd2-eac1-41eb-a85a-23d98d6e486b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:11.119878 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1dc41cd2-eac1-41eb-a85a-23d98d6e486b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:11.120438 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1dc41cd2-eac1-41eb-a85a-23d98d6e486b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:11.120861 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1dc41cd2-eac1-41eb-a85a-23d98d6e486b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:11.126333 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=100 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:11.245615 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f5b05fda-10f3-42b5-84fd-8307116ebe97 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:11.246721 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f5b05fda-10f3-42b5-84fd-8307116ebe97 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:11.253074 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f5b05fda-10f3-42b5-84fd-8307116ebe97 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:11.253572 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f5b05fda-10f3-42b5-84fd-8307116ebe97 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:11.254027 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f5b05fda-10f3-42b5-84fd-8307116ebe97 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:11.254736 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f5b05fda-10f3-42b5-84fd-8307116ebe97 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:11.255372 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f5b05fda-10f3-42b5-84fd-8307116ebe97 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:11.255976 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f5b05fda-10f3-42b5-84fd-8307116ebe97 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:11.283198 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1dc41cd2-eac1-41eb-a85a-23d98d6e486b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:11.293743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1dc41cd2-eac1-41eb-a85a-23d98d6e486b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1266 microversion: 2.1 time: 0.198745 Aug 26 11:13:11.294814 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 441/906] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:11 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:11.418348 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f5b05fda-10f3-42b5-84fd-8307116ebe97 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:11.427311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f5b05fda-10f3-42b5-84fd-8307116ebe97 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1314 microversion: 2.1 time: 0.186732 Aug 26 11:13:11.428705 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 466/907] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:11 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:13:12.319532 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-102ff8b8-2a2e-4a56-ba21-399a81fa447d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:12.320709 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-102ff8b8-2a2e-4a56-ba21-399a81fa447d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:12.331289 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-102ff8b8-2a2e-4a56-ba21-399a81fa447d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:12.332001 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-102ff8b8-2a2e-4a56-ba21-399a81fa447d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:12.332719 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-102ff8b8-2a2e-4a56-ba21-399a81fa447d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:12.333881 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-102ff8b8-2a2e-4a56-ba21-399a81fa447d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:12.334710 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-102ff8b8-2a2e-4a56-ba21-399a81fa447d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:12.335451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-102ff8b8-2a2e-4a56-ba21-399a81fa447d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:12.451374 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-efcb426f-db5c-4d39-bccb-b3a28d3d7734 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:12.452001 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-efcb426f-db5c-4d39-bccb-b3a28d3d7734 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:12.458722 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-efcb426f-db5c-4d39-bccb-b3a28d3d7734 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:12.459212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-efcb426f-db5c-4d39-bccb-b3a28d3d7734 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:12.459646 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-efcb426f-db5c-4d39-bccb-b3a28d3d7734 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:12.460353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-efcb426f-db5c-4d39-bccb-b3a28d3d7734 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:12.461019 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-efcb426f-db5c-4d39-bccb-b3a28d3d7734 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:12.461445 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-efcb426f-db5c-4d39-bccb-b3a28d3d7734 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:12.481058 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-102ff8b8-2a2e-4a56-ba21-399a81fa447d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:12.490640 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-102ff8b8-2a2e-4a56-ba21-399a81fa447d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1266 microversion: 2.1 time: 0.177790 Aug 26 11:13:12.491231 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 442/908] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:12 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:12.598762 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-efcb426f-db5c-4d39-bccb-b3a28d3d7734 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:12.613929 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-efcb426f-db5c-4d39-bccb-b3a28d3d7734 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1498 microversion: 2.1 time: 0.166685 Aug 26 11:13:12.614813 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 467/909] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:12 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:13:13.080534 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-38dd43dc-a74a-4faf-93dc-96396b45107d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:13.081025 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-38dd43dc-a74a-4faf-93dc-96396b45107d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:13.087077 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38dd43dc-a74a-4faf-93dc-96396b45107d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:13.087553 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38dd43dc-a74a-4faf-93dc-96396b45107d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:13.087985 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38dd43dc-a74a-4faf-93dc-96396b45107d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:13.088677 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38dd43dc-a74a-4faf-93dc-96396b45107d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:13.089120 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38dd43dc-a74a-4faf-93dc-96396b45107d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:13.089538 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38dd43dc-a74a-4faf-93dc-96396b45107d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:13.117513 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-38dd43dc-a74a-4faf-93dc-96396b45107d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:13:13.194727 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-38dd43dc-a74a-4faf-93dc-96396b45107d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "DELETE /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 204 len: 0 microversion: 2.1 time: 0.117650 Aug 26 11:13:13.195502 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 443/910] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:13:13 2022] DELETE /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:13:13.204596 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-e46b0c11-3abb-4aea-abd5-6be5886ad96d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:13.205474 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e46b0c11-3abb-4aea-abd5-6be5886ad96d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:13.212560 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e46b0c11-3abb-4aea-abd5-6be5886ad96d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:13.213051 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e46b0c11-3abb-4aea-abd5-6be5886ad96d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:13.213493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e46b0c11-3abb-4aea-abd5-6be5886ad96d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:13.214217 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e46b0c11-3abb-4aea-abd5-6be5886ad96d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:13.214677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e46b0c11-3abb-4aea-abd5-6be5886ad96d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:13.215102 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e46b0c11-3abb-4aea-abd5-6be5886ad96d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:13.346146 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-e46b0c11-3abb-4aea-abd5-6be5886ad96d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:13.354656 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-e46b0c11-3abb-4aea-abd5-6be5886ad96d tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1504 microversion: 2.1 time: 0.154879 Aug 26 11:13:13.355234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 468/911] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:13 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:13.511863 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5d39b970-4b83-4380-a94e-84896fecc99b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:13.512569 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5d39b970-4b83-4380-a94e-84896fecc99b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:13.519258 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d39b970-4b83-4380-a94e-84896fecc99b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:13.519754 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d39b970-4b83-4380-a94e-84896fecc99b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:13.520191 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d39b970-4b83-4380-a94e-84896fecc99b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:13.520950 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d39b970-4b83-4380-a94e-84896fecc99b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:13.521428 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d39b970-4b83-4380-a94e-84896fecc99b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:13.521859 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d39b970-4b83-4380-a94e-84896fecc99b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:13.679908 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5d39b970-4b83-4380-a94e-84896fecc99b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:13.687889 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5d39b970-4b83-4380-a94e-84896fecc99b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1266 microversion: 2.1 time: 0.180177 Aug 26 11:13:13.688550 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 444/912] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:13 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:14.376866 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-fed4f17a-cf70-447d-b8ff-6ec8d468deda tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:14.377476 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-fed4f17a-cf70-447d-b8ff-6ec8d468deda tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:14.384125 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fed4f17a-cf70-447d-b8ff-6ec8d468deda tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:14.384614 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fed4f17a-cf70-447d-b8ff-6ec8d468deda tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:14.385048 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fed4f17a-cf70-447d-b8ff-6ec8d468deda tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:14.385748 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fed4f17a-cf70-447d-b8ff-6ec8d468deda tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:14.386238 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fed4f17a-cf70-447d-b8ff-6ec8d468deda tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:14.386746 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fed4f17a-cf70-447d-b8ff-6ec8d468deda tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:14.529310 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-fed4f17a-cf70-447d-b8ff-6ec8d468deda tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:14.538065 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-fed4f17a-cf70-447d-b8ff-6ec8d468deda tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1504 microversion: 2.1 time: 0.165984 Aug 26 11:13:14.538698 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 469/913] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:14 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:14.714574 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-fc5d5626-4137-4b5e-b86a-52139ba5fb84 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:14.715218 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-fc5d5626-4137-4b5e-b86a-52139ba5fb84 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:14.722714 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc5d5626-4137-4b5e-b86a-52139ba5fb84 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:14.723155 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc5d5626-4137-4b5e-b86a-52139ba5fb84 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:14.723591 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc5d5626-4137-4b5e-b86a-52139ba5fb84 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:14.724294 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc5d5626-4137-4b5e-b86a-52139ba5fb84 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:14.724745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc5d5626-4137-4b5e-b86a-52139ba5fb84 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:14.725165 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc5d5626-4137-4b5e-b86a-52139ba5fb84 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:14.865797 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-fc5d5626-4137-4b5e-b86a-52139ba5fb84 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:14.874318 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-fc5d5626-4137-4b5e-b86a-52139ba5fb84 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1266 microversion: 2.1 time: 0.163654 Aug 26 11:13:14.874914 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 445/914] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:14 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:15.386203 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-959d94db-9ab5-4a98-809e-25331e021192 req-326dd949-59d7-4714-9e27-25740c40d1da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93ee60f8-1765-4fa7-911e-bba285cfd593", "name": "network-vif-deleted", "tag": "17d5fa78-5e85-42fc-a522-13a7d91a2705"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:13:15.397750 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-959d94db-9ab5-4a98-809e-25331e021192 req-326dd949-59d7-4714-9e27-25740c40d1da service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:15.398342 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-959d94db-9ab5-4a98-809e-25331e021192 req-326dd949-59d7-4714-9e27-25740c40d1da service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:15.398834 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-959d94db-9ab5-4a98-809e-25331e021192 req-326dd949-59d7-4714-9e27-25740c40d1da service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:15.411576 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-959d94db-9ab5-4a98-809e-25331e021192 req-326dd949-59d7-4714-9e27-25740c40d1da service nova] Creating event network-vif-deleted:17d5fa78-5e85-42fc-a522-13a7d91a2705 for instance 93ee60f8-1765-4fa7-911e-bba285cfd593 on hv-cinder-85236 Aug 26 11:13:15.416737 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-959d94db-9ab5-4a98-809e-25331e021192 req-326dd949-59d7-4714-9e27-25740c40d1da service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034780 Aug 26 11:13:15.417427 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 470/915] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:13:15.560934 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1984d5ff-6b89-42d8-bad2-5d07a05b77c7 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:15.562142 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1984d5ff-6b89-42d8-bad2-5d07a05b77c7 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:15.568078 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1984d5ff-6b89-42d8-bad2-5d07a05b77c7 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:15.568655 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1984d5ff-6b89-42d8-bad2-5d07a05b77c7 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:15.569203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1984d5ff-6b89-42d8-bad2-5d07a05b77c7 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:15.569999 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1984d5ff-6b89-42d8-bad2-5d07a05b77c7 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:15.570534 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1984d5ff-6b89-42d8-bad2-5d07a05b77c7 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:15.571032 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1984d5ff-6b89-42d8-bad2-5d07a05b77c7 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:15.662973 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1984d5ff-6b89-42d8-bad2-5d07a05b77c7 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:15.674632 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1984d5ff-6b89-42d8-bad2-5d07a05b77c7 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 200 len: 1462 microversion: 2.1 time: 0.117706 Aug 26 11:13:15.678026 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 446/916] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:15 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 1462 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:13:15.895696 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-59ddcda6-fe54-49cf-bbf8-00613e67f4a3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:15.896298 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-59ddcda6-fe54-49cf-bbf8-00613e67f4a3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:15.902558 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-59ddcda6-fe54-49cf-bbf8-00613e67f4a3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:15.903045 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-59ddcda6-fe54-49cf-bbf8-00613e67f4a3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:15.904021 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-59ddcda6-fe54-49cf-bbf8-00613e67f4a3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:15.904725 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-59ddcda6-fe54-49cf-bbf8-00613e67f4a3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:15.905201 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-59ddcda6-fe54-49cf-bbf8-00613e67f4a3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:15.905622 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-59ddcda6-fe54-49cf-bbf8-00613e67f4a3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:16.057312 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-59ddcda6-fe54-49cf-bbf8-00613e67f4a3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:16.065689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-59ddcda6-fe54-49cf-bbf8-00613e67f4a3 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1266 microversion: 2.1 time: 0.174323 Aug 26 11:13:16.066295 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 471/917] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:15 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:16.714224 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d10a05e6-7f96-4729-8f70-2aae081b02e3 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:16.716622 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d10a05e6-7f96-4729-8f70-2aae081b02e3 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 93ee60f8-1765-4fa7-911e-bba285cfd593] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:16.724480 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d10a05e6-7f96-4729-8f70-2aae081b02e3 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:16.725024 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d10a05e6-7f96-4729-8f70-2aae081b02e3 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:16.725456 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d10a05e6-7f96-4729-8f70-2aae081b02e3 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:16.726202 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d10a05e6-7f96-4729-8f70-2aae081b02e3 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:16.726657 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d10a05e6-7f96-4729-8f70-2aae081b02e3 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:16.727074 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d10a05e6-7f96-4729-8f70-2aae081b02e3 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:16.743821 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-d10a05e6-7f96-4729-8f70-2aae081b02e3 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] HTTP exception thrown: Instance 93ee60f8-1765-4fa7-911e-bba285cfd593 could not be found. Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d10a05e6-7f96-4729-8f70-2aae081b02e3 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Request method failure captured: Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 HTTP/1.1 Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKqzWzLN5kiy8Zi1jZ9FoLac40ssmc71zZGKp6NbYYyDyOfkrk7Yw2nGzXgcf6k5QGcBDWHATP5YF2RGdeRAFuyMMKafDX91U4nLH_JNPlUZTXHDobaLCt07WiLrek0u9gh1ZSBXGSbuQ5rtu9gJcDybllcGC4-Wv7SNCNjJWKoxMDY Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: ef07a23929104d298d85485c33a0411e Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-VolumesActionsTest-1698785244 Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:13:16.745478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:13:16.747755 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ef07a23929104d298d85485c33a0411e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ef07a23929104d298d85485c33a0411e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef07a23929104d298d85485c33a0411e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef07a23929104d298d85485c33a0411e"}]}] Aug 26 11:13:16.747755 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-VolumesActionsTest-1698785244 Aug 26 11:13:16.747755 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: ef07a23929104d298d85485c33a0411e Aug 26 11:13:16.747755 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-VolumesActionsTest-1698785244 Aug 26 11:13:16.747755 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-VolumesActionsTest-1698785244-project Aug 26 11:13:16.747755 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:13:16.747755 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:13:16.747755 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: b4ea31e78ceb46f8bc92d86211da5072 Aug 26 11:13:16.747755 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-VolumesActionsTest-1698785244-project Aug 26 11:13:16.747755 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:13:16.747755 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance 93ee60f8-1765-4fa7-911e-bba285cfd593 could not be found. Aug 26 11:13:16.747755 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': '93ee60f8-1765-4fa7-911e-bba285cfd593'} Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93ee60f8-1765-4fa7-911e-bba285cfd593 could not be found. Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:13:16.749743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93ee60f8-1765-4fa7-911e-bba285cfd593 could not be found. Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93ee60f8-1765-4fa7-911e-bba285cfd593 could not be found. Aug 26 11:13:16.751338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:16.752710 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d10a05e6-7f96-4729-8f70-2aae081b02e3 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Returning 404 to user: Instance 93ee60f8-1765-4fa7-911e-bba285cfd593 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:13:16.752710 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d10a05e6-7f96-4729-8f70-2aae081b02e3 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593" status: 404 len: 111 microversion: 2.1 time: 0.038677 Aug 26 11:13:16.752710 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 447/918] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:16 2022] GET /compute/v2.1/servers/93ee60f8-1765-4fa7-911e-bba285cfd593 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:13:16.851698 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-64199572", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452", "networks": [{"uuid": "00388d55-2f96-4066-8c5d-4eae49ca7711"}]}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:13:16.862552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:16.862552 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=8 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:16.920823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.network.neutron [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] validate_networks() for [('00388d55-2f96-4066-8c5d-4eae49ca7711', None, None, None, None, None)] {{(pid=120605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:13:17.089158 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-23d37b1c-d63c-4d11-afd1-bfdeb88aeea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:17.090222 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-23d37b1c-d63c-4d11-afd1-bfdeb88aeea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:17.100069 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23d37b1c-d63c-4d11-afd1-bfdeb88aeea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:17.100851 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23d37b1c-d63c-4d11-afd1-bfdeb88aeea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:17.101587 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23d37b1c-d63c-4d11-afd1-bfdeb88aeea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:17.102910 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23d37b1c-d63c-4d11-afd1-bfdeb88aeea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:17.103503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23d37b1c-d63c-4d11-afd1-bfdeb88aeea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:17.104478 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23d37b1c-d63c-4d11-afd1-bfdeb88aeea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:17.489420 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-23d37b1c-d63c-4d11-afd1-bfdeb88aeea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:17.498288 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-23d37b1c-d63c-4d11-afd1-bfdeb88aeea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1266 microversion: 2.1 time: 0.414050 Aug 26 11:13:17.499092 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 448/919] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:17 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1266 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:13:17.632357 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Flavor limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:13:17.632812 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Image limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:13:17.633319 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Flavor pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:13:17.633748 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Image pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:13:17.634200 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:13:17.643158 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:17.643886 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:17.644267 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:17.644789 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:17.645285 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:17.647261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:17.657268 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:17.664912 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Getting quotas for project ef07a23929104d298d85485c33a0411e. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:13:17.670491 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Getting quotas for user b4ea31e78ceb46f8bc92d86211da5072 and project ef07a23929104d298d85485c33a0411e. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:13:17.682148 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Going to run 1 instances... {{(pid=120605) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:13:17.684440 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:13:17.733493 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-75de68ef-98c6-4e31-bef9-90c15ae119ad tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885514 Aug 26 11:13:17.734191 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 472/920] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:13:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:13:17.744987 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-77f891ec-fbf9-4791-bf66-cf3642ef53ca tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:17.745613 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-77f891ec-fbf9-4791-bf66-cf3642ef53ca tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:17.822182 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-77f891ec-fbf9-4791-bf66-cf3642ef53ca tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:17.830501 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-77f891ec-fbf9-4791-bf66-cf3642ef53ca tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4" status: 200 len: 1212 microversion: 2.1 time: 0.089249 Aug 26 11:13:17.831083 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 449/921] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:17 2022] GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:18.522382 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-6d4ae40c-2da1-4491-b150-237cd402e35b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:18.523064 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-6d4ae40c-2da1-4491-b150-237cd402e35b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:18.534472 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d4ae40c-2da1-4491-b150-237cd402e35b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:18.536709 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d4ae40c-2da1-4491-b150-237cd402e35b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:18.538660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d4ae40c-2da1-4491-b150-237cd402e35b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:18.540188 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d4ae40c-2da1-4491-b150-237cd402e35b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:18.541601 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d4ae40c-2da1-4491-b150-237cd402e35b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:18.542559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6d4ae40c-2da1-4491-b150-237cd402e35b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:18.692214 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6d4ae40c-2da1-4491-b150-237cd402e35b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:18.701787 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-6d4ae40c-2da1-4491-b150-237cd402e35b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1266 microversion: 2.1 time: 0.184958 Aug 26 11:13:18.705967 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 473/922] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:18 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:18.860242 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-aaaefbe5-f79d-4275-b6e4-83bfbc168438 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:18.862404 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-aaaefbe5-f79d-4275-b6e4-83bfbc168438 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:18.869537 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aaaefbe5-f79d-4275-b6e4-83bfbc168438 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:18.870533 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aaaefbe5-f79d-4275-b6e4-83bfbc168438 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:18.870533 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aaaefbe5-f79d-4275-b6e4-83bfbc168438 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:18.871197 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aaaefbe5-f79d-4275-b6e4-83bfbc168438 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:18.871684 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aaaefbe5-f79d-4275-b6e4-83bfbc168438 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:18.872957 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aaaefbe5-f79d-4275-b6e4-83bfbc168438 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:18.945572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-aaaefbe5-f79d-4275-b6e4-83bfbc168438 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:18.953686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-aaaefbe5-f79d-4275-b6e4-83bfbc168438 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4" status: 200 len: 1264 microversion: 2.1 time: 0.104896 Aug 26 11:13:18.954299 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 450/923] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:18 2022] GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 => generated 1264 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:19.723402 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5806a4e8-d54b-4fe0-88ee-ee09eaa6fe09 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:19.724034 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5806a4e8-d54b-4fe0-88ee-ee09eaa6fe09 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:19.733400 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5806a4e8-d54b-4fe0-88ee-ee09eaa6fe09 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:19.734212 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5806a4e8-d54b-4fe0-88ee-ee09eaa6fe09 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:19.735098 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5806a4e8-d54b-4fe0-88ee-ee09eaa6fe09 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:19.736587 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5806a4e8-d54b-4fe0-88ee-ee09eaa6fe09 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:19.737250 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5806a4e8-d54b-4fe0-88ee-ee09eaa6fe09 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:19.737801 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5806a4e8-d54b-4fe0-88ee-ee09eaa6fe09 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:19.932972 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5806a4e8-d54b-4fe0-88ee-ee09eaa6fe09 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:19.945765 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5806a4e8-d54b-4fe0-88ee-ee09eaa6fe09 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1266 microversion: 2.1 time: 0.226339 Aug 26 11:13:19.946567 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 474/924] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:19 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:19.976382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-43323117-7af0-4b0a-b551-9596c89db1cb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:19.977003 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-43323117-7af0-4b0a-b551-9596c89db1cb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:19.984854 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43323117-7af0-4b0a-b551-9596c89db1cb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:19.985590 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43323117-7af0-4b0a-b551-9596c89db1cb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:19.987727 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43323117-7af0-4b0a-b551-9596c89db1cb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:19.988644 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43323117-7af0-4b0a-b551-9596c89db1cb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:19.989447 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43323117-7af0-4b0a-b551-9596c89db1cb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:19.990068 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43323117-7af0-4b0a-b551-9596c89db1cb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:20.064615 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-cd9d22a1-3cc9-4712-862a-cd616c7094a8 req-f3f5ef96-218c-42db-af8e-23459d0b664a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e72f32-b26f-4799-b3c9-dd6352d5c100", "name": "network-vif-plugged", "status": "completed", "tag": "202f8947-cca0-41bf-9a36-01029ac31a92"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:13:20.083206 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-cd9d22a1-3cc9-4712-862a-cd616c7094a8 req-f3f5ef96-218c-42db-af8e-23459d0b664a service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:20.083977 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-cd9d22a1-3cc9-4712-862a-cd616c7094a8 req-f3f5ef96-218c-42db-af8e-23459d0b664a service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:20.084593 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-cd9d22a1-3cc9-4712-862a-cd616c7094a8 req-f3f5ef96-218c-42db-af8e-23459d0b664a service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:20.106299 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-cd9d22a1-3cc9-4712-862a-cd616c7094a8 req-f3f5ef96-218c-42db-af8e-23459d0b664a service nova] Creating event network-vif-plugged:202f8947-cca0-41bf-9a36-01029ac31a92 for instance c8e72f32-b26f-4799-b3c9-dd6352d5c100 on hv-cinder-85236 Aug 26 11:13:20.121123 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-cd9d22a1-3cc9-4712-862a-cd616c7094a8 req-f3f5ef96-218c-42db-af8e-23459d0b664a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060248 Aug 26 11:13:20.125639 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 475/925] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:13:20.214354 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-43323117-7af0-4b0a-b551-9596c89db1cb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:20.222961 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-43323117-7af0-4b0a-b551-9596c89db1cb tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4" status: 200 len: 1312 microversion: 2.1 time: 0.250248 Aug 26 11:13:20.224418 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 451/926] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:19 2022] GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 => generated 1312 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:20.790462 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-7ee7cde8-8780-4a80-a476-9be87c34d778 req-650526e5-920c-4d50-a6a6-7d20f5de8037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e96e3e-0ce8-4787-8e91-0b2a656c27e4", "tag": "f8878c2e-b504-4e48-8acd-793d3d253650"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:13:20.802341 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-7ee7cde8-8780-4a80-a476-9be87c34d778 req-650526e5-920c-4d50-a6a6-7d20f5de8037 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:20.802985 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-7ee7cde8-8780-4a80-a476-9be87c34d778 req-650526e5-920c-4d50-a6a6-7d20f5de8037 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:20.803680 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-7ee7cde8-8780-4a80-a476-9be87c34d778 req-650526e5-920c-4d50-a6a6-7d20f5de8037 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:20.817153 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-7ee7cde8-8780-4a80-a476-9be87c34d778 req-650526e5-920c-4d50-a6a6-7d20f5de8037 service nova] Creating event network-changed:f8878c2e-b504-4e48-8acd-793d3d253650 for instance 74e96e3e-0ce8-4787-8e91-0b2a656c27e4 on hv-cinder-85236 Aug 26 11:13:20.822824 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-7ee7cde8-8780-4a80-a476-9be87c34d778 req-650526e5-920c-4d50-a6a6-7d20f5de8037 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037840 Aug 26 11:13:20.823657 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 476/927] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:13:20.968314 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-84f431d7-2ef9-4c9c-a0b3-53b64ab2cf59 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:20.968937 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-84f431d7-2ef9-4c9c-a0b3-53b64ab2cf59 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:20.971192 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:20.977133 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-84f431d7-2ef9-4c9c-a0b3-53b64ab2cf59 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:20.977869 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-84f431d7-2ef9-4c9c-a0b3-53b64ab2cf59 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:20.978036 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-84f431d7-2ef9-4c9c-a0b3-53b64ab2cf59 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:20.978721 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-84f431d7-2ef9-4c9c-a0b3-53b64ab2cf59 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:20.979176 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-84f431d7-2ef9-4c9c-a0b3-53b64ab2cf59 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:20.979596 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-84f431d7-2ef9-4c9c-a0b3-53b64ab2cf59 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:21.256020 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1b8cec7a-068a-416d-96b7-11ebf652f831 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:21.256725 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-1b8cec7a-068a-416d-96b7-11ebf652f831 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:21.263469 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1b8cec7a-068a-416d-96b7-11ebf652f831 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:21.264378 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1b8cec7a-068a-416d-96b7-11ebf652f831 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:21.264812 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1b8cec7a-068a-416d-96b7-11ebf652f831 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:21.265515 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1b8cec7a-068a-416d-96b7-11ebf652f831 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:21.265964 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1b8cec7a-068a-416d-96b7-11ebf652f831 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:21.266405 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1b8cec7a-068a-416d-96b7-11ebf652f831 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:21.275650 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-84f431d7-2ef9-4c9c-a0b3-53b64ab2cf59 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:21.286338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-84f431d7-2ef9-4c9c-a0b3-53b64ab2cf59 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1266 microversion: 2.1 time: 0.322878 Aug 26 11:13:21.286913 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 452/928] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:20 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1266 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:21.406922 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1b8cec7a-068a-416d-96b7-11ebf652f831 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:21.414941 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1b8cec7a-068a-416d-96b7-11ebf652f831 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4" status: 200 len: 1312 microversion: 2.1 time: 0.163275 Aug 26 11:13:21.415726 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 477/929] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:21 2022] GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:13:22.309039 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-afa2f18e-4129-4fe8-a7c8-027ead0c9717 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:22.309605 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-afa2f18e-4129-4fe8-a7c8-027ead0c9717 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:22.316829 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-afa2f18e-4129-4fe8-a7c8-027ead0c9717 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:22.317315 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-afa2f18e-4129-4fe8-a7c8-027ead0c9717 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:22.317751 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-afa2f18e-4129-4fe8-a7c8-027ead0c9717 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:22.318480 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-afa2f18e-4129-4fe8-a7c8-027ead0c9717 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:22.318935 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-afa2f18e-4129-4fe8-a7c8-027ead0c9717 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:22.319361 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-afa2f18e-4129-4fe8-a7c8-027ead0c9717 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:22.438206 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-bd7b994e-e8c8-45fd-b2a1-ba30fd53c7e2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:22.438871 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-bd7b994e-e8c8-45fd-b2a1-ba30fd53c7e2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:22.445891 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bd7b994e-e8c8-45fd-b2a1-ba30fd53c7e2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:22.446407 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bd7b994e-e8c8-45fd-b2a1-ba30fd53c7e2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:22.447188 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bd7b994e-e8c8-45fd-b2a1-ba30fd53c7e2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:22.447967 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bd7b994e-e8c8-45fd-b2a1-ba30fd53c7e2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:22.448474 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bd7b994e-e8c8-45fd-b2a1-ba30fd53c7e2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:22.448899 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bd7b994e-e8c8-45fd-b2a1-ba30fd53c7e2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:22.461330 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-afa2f18e-4129-4fe8-a7c8-027ead0c9717 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:22.469747 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-afa2f18e-4129-4fe8-a7c8-027ead0c9717 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1266 microversion: 2.1 time: 0.164617 Aug 26 11:13:22.470342 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 453/930] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:22 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:22.593334 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-bd7b994e-e8c8-45fd-b2a1-ba30fd53c7e2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:22.602456 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-bd7b994e-e8c8-45fd-b2a1-ba30fd53c7e2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4" status: 200 len: 1312 microversion: 2.1 time: 0.169585 Aug 26 11:13:22.603352 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 478/931] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:22 2022] GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:13:23.492155 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1f208877-28f0-4bd8-b5c6-d76a19158d42 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:23.492771 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1f208877-28f0-4bd8-b5c6-d76a19158d42 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:23.499676 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f208877-28f0-4bd8-b5c6-d76a19158d42 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:23.500153 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f208877-28f0-4bd8-b5c6-d76a19158d42 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:23.500615 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f208877-28f0-4bd8-b5c6-d76a19158d42 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:23.501309 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f208877-28f0-4bd8-b5c6-d76a19158d42 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:23.501755 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f208877-28f0-4bd8-b5c6-d76a19158d42 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:23.502203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f208877-28f0-4bd8-b5c6-d76a19158d42 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:23.624178 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-2a8de51f-0599-407b-b431-b5304412bf88 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:23.624799 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-2a8de51f-0599-407b-b431-b5304412bf88 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:23.631281 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2a8de51f-0599-407b-b431-b5304412bf88 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:23.631779 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2a8de51f-0599-407b-b431-b5304412bf88 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:23.632223 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2a8de51f-0599-407b-b431-b5304412bf88 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:23.632556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1f208877-28f0-4bd8-b5c6-d76a19158d42 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:23.633383 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2a8de51f-0599-407b-b431-b5304412bf88 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:23.634067 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2a8de51f-0599-407b-b431-b5304412bf88 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:23.634502 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2a8de51f-0599-407b-b431-b5304412bf88 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:23.641465 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1f208877-28f0-4bd8-b5c6-d76a19158d42 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1453 microversion: 2.1 time: 0.153196 Aug 26 11:13:23.651040 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 454/932] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:23 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:23.662311 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4ee1f2f5-1b2b-4bb5-afce-0d698f973b49 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:23.662964 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4ee1f2f5-1b2b-4bb5-afce-0d698f973b49 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:23.669577 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4ee1f2f5-1b2b-4bb5-afce-0d698f973b49 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:23.670383 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4ee1f2f5-1b2b-4bb5-afce-0d698f973b49 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:23.670928 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4ee1f2f5-1b2b-4bb5-afce-0d698f973b49 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:23.671634 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4ee1f2f5-1b2b-4bb5-afce-0d698f973b49 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:23.672088 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4ee1f2f5-1b2b-4bb5-afce-0d698f973b49 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:23.672512 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4ee1f2f5-1b2b-4bb5-afce-0d698f973b49 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:23.824272 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-2a8de51f-0599-407b-b431-b5304412bf88 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:23.832539 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-2a8de51f-0599-407b-b431-b5304412bf88 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4" status: 200 len: 1312 microversion: 2.1 time: 0.212566 Aug 26 11:13:23.833120 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 479/933] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:23 2022] GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 => generated 1312 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:13:23.850399 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4ee1f2f5-1b2b-4bb5-afce-0d698f973b49 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:23.858085 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4ee1f2f5-1b2b-4bb5-afce-0d698f973b49 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1453 microversion: 2.1 time: 0.199660 Aug 26 11:13:23.858643 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 455/934] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:23 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1453 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:13:24.853144 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c63398bc-efc1-4d2d-a201-33bbb0693cf4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:24.853803 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c63398bc-efc1-4d2d-a201-33bbb0693cf4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:24.860556 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c63398bc-efc1-4d2d-a201-33bbb0693cf4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:24.861045 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c63398bc-efc1-4d2d-a201-33bbb0693cf4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:24.861480 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c63398bc-efc1-4d2d-a201-33bbb0693cf4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:24.862224 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c63398bc-efc1-4d2d-a201-33bbb0693cf4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:24.862684 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c63398bc-efc1-4d2d-a201-33bbb0693cf4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:24.863104 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c63398bc-efc1-4d2d-a201-33bbb0693cf4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:25.006260 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c63398bc-efc1-4d2d-a201-33bbb0693cf4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:25.014300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c63398bc-efc1-4d2d-a201-33bbb0693cf4 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4" status: 200 len: 1312 microversion: 2.1 time: 0.164978 Aug 26 11:13:25.015046 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 480/935] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:24 2022] GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:25.503015 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-487d0ce5-edd5-4a55-a3a5-49acb6a2d5c2 req-beb2d52f-b008-4954-a3f2-ca03cdbd03fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e72f32-b26f-4799-b3c9-dd6352d5c100", "tag": "202f8947-cca0-41bf-9a36-01029ac31a92"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:13:25.513875 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-487d0ce5-edd5-4a55-a3a5-49acb6a2d5c2 req-beb2d52f-b008-4954-a3f2-ca03cdbd03fa service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:25.514485 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-487d0ce5-edd5-4a55-a3a5-49acb6a2d5c2 req-beb2d52f-b008-4954-a3f2-ca03cdbd03fa service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:25.515030 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-487d0ce5-edd5-4a55-a3a5-49acb6a2d5c2 req-beb2d52f-b008-4954-a3f2-ca03cdbd03fa service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:25.527323 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-487d0ce5-edd5-4a55-a3a5-49acb6a2d5c2 req-beb2d52f-b008-4954-a3f2-ca03cdbd03fa service nova] Creating event network-changed:202f8947-cca0-41bf-9a36-01029ac31a92 for instance c8e72f32-b26f-4799-b3c9-dd6352d5c100 on hv-cinder-85236 Aug 26 11:13:25.533352 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-487d0ce5-edd5-4a55-a3a5-49acb6a2d5c2 req-beb2d52f-b008-4954-a3f2-ca03cdbd03fa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034283 Aug 26 11:13:25.534084 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 456/936] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:13:26.037620 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b1014499-7ed3-4f68-a9db-4bc1bcc2a441 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:26.038995 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b1014499-7ed3-4f68-a9db-4bc1bcc2a441 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:26.047163 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1014499-7ed3-4f68-a9db-4bc1bcc2a441 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:26.047689 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1014499-7ed3-4f68-a9db-4bc1bcc2a441 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:26.048137 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1014499-7ed3-4f68-a9db-4bc1bcc2a441 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:26.049131 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1014499-7ed3-4f68-a9db-4bc1bcc2a441 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:26.049590 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1014499-7ed3-4f68-a9db-4bc1bcc2a441 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:26.050260 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b1014499-7ed3-4f68-a9db-4bc1bcc2a441 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:26.192037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b1014499-7ed3-4f68-a9db-4bc1bcc2a441 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:26.199827 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b1014499-7ed3-4f68-a9db-4bc1bcc2a441 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4" status: 200 len: 1312 microversion: 2.1 time: 0.166032 Aug 26 11:13:26.200967 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 481/937] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:26 2022] GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:27.222504 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-be65bf54-0aa8-44cd-941d-6b4f4ace3895 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:27.223200 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-be65bf54-0aa8-44cd-941d-6b4f4ace3895 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:27.229293 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-be65bf54-0aa8-44cd-941d-6b4f4ace3895 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:27.229772 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-be65bf54-0aa8-44cd-941d-6b4f4ace3895 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:27.230231 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-be65bf54-0aa8-44cd-941d-6b4f4ace3895 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:27.230928 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-be65bf54-0aa8-44cd-941d-6b4f4ace3895 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:27.232047 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-be65bf54-0aa8-44cd-941d-6b4f4ace3895 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:27.232476 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-be65bf54-0aa8-44cd-941d-6b4f4ace3895 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:27.366477 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-be65bf54-0aa8-44cd-941d-6b4f4ace3895 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:27.374412 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-be65bf54-0aa8-44cd-941d-6b4f4ace3895 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4" status: 200 len: 1312 microversion: 2.1 time: 0.156747 Aug 26 11:13:27.374965 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 457/938] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:27 2022] GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:28.007641 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-ac2149d0-169a-4a49-aa23-00e766d1db02 req-a4c1fe44-3c49-49df-a0f8-c4790a0bab0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e96e3e-0ce8-4787-8e91-0b2a656c27e4", "name": "network-vif-plugged", "status": "completed", "tag": "f8878c2e-b504-4e48-8acd-793d3d253650"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:13:28.013844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:28.014518 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=6 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:28.020328 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-ac2149d0-169a-4a49-aa23-00e766d1db02 req-a4c1fe44-3c49-49df-a0f8-c4790a0bab0c service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:28.020944 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-ac2149d0-169a-4a49-aa23-00e766d1db02 req-a4c1fe44-3c49-49df-a0f8-c4790a0bab0c service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:28.021421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-ac2149d0-169a-4a49-aa23-00e766d1db02 req-a4c1fe44-3c49-49df-a0f8-c4790a0bab0c service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:28.034664 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-ac2149d0-169a-4a49-aa23-00e766d1db02 req-a4c1fe44-3c49-49df-a0f8-c4790a0bab0c service nova] Creating event network-vif-plugged:f8878c2e-b504-4e48-8acd-793d3d253650 for instance 74e96e3e-0ce8-4787-8e91-0b2a656c27e4 on hv-cinder-85236 Aug 26 11:13:28.039566 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-ac2149d0-169a-4a49-aa23-00e766d1db02 req-a4c1fe44-3c49-49df-a0f8-c4790a0bab0c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035590 Aug 26 11:13:28.040180 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 482/939] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:13:28.395381 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9c2f0753-ad7e-43ea-b1fa-3d2615e9d1a2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:28.396121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9c2f0753-ad7e-43ea-b1fa-3d2615e9d1a2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:28.398139 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:28.404247 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9c2f0753-ad7e-43ea-b1fa-3d2615e9d1a2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:28.404772 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9c2f0753-ad7e-43ea-b1fa-3d2615e9d1a2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:28.405244 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9c2f0753-ad7e-43ea-b1fa-3d2615e9d1a2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:28.406003 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9c2f0753-ad7e-43ea-b1fa-3d2615e9d1a2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:28.406466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9c2f0753-ad7e-43ea-b1fa-3d2615e9d1a2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:28.406918 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9c2f0753-ad7e-43ea-b1fa-3d2615e9d1a2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:28.421950 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:28.548054 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9c2f0753-ad7e-43ea-b1fa-3d2615e9d1a2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:28.555732 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9c2f0753-ad7e-43ea-b1fa-3d2615e9d1a2 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4" status: 200 len: 1312 microversion: 2.1 time: 0.164252 Aug 26 11:13:28.556284 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 458/940] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:28 2022] GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:29.579598 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-7795f53c-37e5-4164-aa17-83055a40295e tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:29.580626 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-7795f53c-37e5-4164-aa17-83055a40295e tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:29.590348 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7795f53c-37e5-4164-aa17-83055a40295e tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:29.591511 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7795f53c-37e5-4164-aa17-83055a40295e tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:29.592057 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7795f53c-37e5-4164-aa17-83055a40295e tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:29.592926 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7795f53c-37e5-4164-aa17-83055a40295e tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:29.593510 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7795f53c-37e5-4164-aa17-83055a40295e tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:29.594089 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-7795f53c-37e5-4164-aa17-83055a40295e tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:29.725948 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-7795f53c-37e5-4164-aa17-83055a40295e tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:29.734442 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-7795f53c-37e5-4164-aa17-83055a40295e tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4" status: 200 len: 1497 microversion: 2.1 time: 0.160801 Aug 26 11:13:29.735037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 483/941] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:29 2022] GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:30.256852 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b8371f48-a270-4064-a266-ab482a39655f tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:30.257355 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b8371f48-a270-4064-a266-ab482a39655f tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:30.264991 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8371f48-a270-4064-a266-ab482a39655f tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:30.265468 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8371f48-a270-4064-a266-ab482a39655f tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:30.265903 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8371f48-a270-4064-a266-ab482a39655f tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:30.266628 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8371f48-a270-4064-a266-ab482a39655f tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:30.267077 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8371f48-a270-4064-a266-ab482a39655f tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:30.267493 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8371f48-a270-4064-a266-ab482a39655f tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:30.293558 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b8371f48-a270-4064-a266-ab482a39655f tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:13:30.369024 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b8371f48-a270-4064-a266-ab482a39655f tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "DELETE /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4" status: 204 len: 0 microversion: 2.1 time: 0.115755 Aug 26 11:13:30.369590 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 459/942] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:13:30 2022] DELETE /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:13:30.379844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-461a8eec-9bc8-452a-95a7-5fd4b932b906 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:30.380453 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-461a8eec-9bc8-452a-95a7-5fd4b932b906 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:30.386612 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-461a8eec-9bc8-452a-95a7-5fd4b932b906 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:30.387006 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-461a8eec-9bc8-452a-95a7-5fd4b932b906 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:30.387437 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-461a8eec-9bc8-452a-95a7-5fd4b932b906 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:30.389137 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-461a8eec-9bc8-452a-95a7-5fd4b932b906 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:30.389595 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-461a8eec-9bc8-452a-95a7-5fd4b932b906 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:30.390043 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-461a8eec-9bc8-452a-95a7-5fd4b932b906 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:30.392806 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=100 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:30.527894 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-461a8eec-9bc8-452a-95a7-5fd4b932b906 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:30.536444 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-461a8eec-9bc8-452a-95a7-5fd4b932b906 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4" status: 200 len: 1503 microversion: 2.1 time: 0.160730 Aug 26 11:13:30.537098 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 484/943] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:30 2022] GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:13:31.558758 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4caf1949-a71e-40ce-ab2b-18f287ecf1c5 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:31.559483 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4caf1949-a71e-40ce-ab2b-18f287ecf1c5 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:31.566089 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4caf1949-a71e-40ce-ab2b-18f287ecf1c5 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:31.566576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4caf1949-a71e-40ce-ab2b-18f287ecf1c5 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:31.567014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4caf1949-a71e-40ce-ab2b-18f287ecf1c5 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:31.567727 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4caf1949-a71e-40ce-ab2b-18f287ecf1c5 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:31.568179 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4caf1949-a71e-40ce-ab2b-18f287ecf1c5 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:31.568601 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4caf1949-a71e-40ce-ab2b-18f287ecf1c5 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:31.699547 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4caf1949-a71e-40ce-ab2b-18f287ecf1c5 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:31.707850 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4caf1949-a71e-40ce-ab2b-18f287ecf1c5 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4" status: 200 len: 1503 microversion: 2.1 time: 0.153448 Aug 26 11:13:31.708407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 460/944] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:31 2022] GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:32.713925 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-f1a0a24a-bf7d-4e56-8aa8-cb6c29f9a5ca req-59ed0239-4f7b-4869-bc8b-93ac3e840b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e96e3e-0ce8-4787-8e91-0b2a656c27e4", "name": "network-vif-deleted", "tag": "f8878c2e-b504-4e48-8acd-793d3d253650"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:13:32.724743 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f1a0a24a-bf7d-4e56-8aa8-cb6c29f9a5ca req-59ed0239-4f7b-4869-bc8b-93ac3e840b17 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:32.725217 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f1a0a24a-bf7d-4e56-8aa8-cb6c29f9a5ca req-59ed0239-4f7b-4869-bc8b-93ac3e840b17 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:32.727945 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f1a0a24a-bf7d-4e56-8aa8-cb6c29f9a5ca req-59ed0239-4f7b-4869-bc8b-93ac3e840b17 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:32.729423 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f8e76c33-91b9-49a8-974e-594d555c4853 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:32.729914 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f8e76c33-91b9-49a8-974e-594d555c4853 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:32.738094 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8e76c33-91b9-49a8-974e-594d555c4853 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:32.738720 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8e76c33-91b9-49a8-974e-594d555c4853 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:32.739187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8e76c33-91b9-49a8-974e-594d555c4853 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:32.739315 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-f1a0a24a-bf7d-4e56-8aa8-cb6c29f9a5ca req-59ed0239-4f7b-4869-bc8b-93ac3e840b17 service nova] Creating event network-vif-deleted:f8878c2e-b504-4e48-8acd-793d3d253650 for instance 74e96e3e-0ce8-4787-8e91-0b2a656c27e4 on hv-cinder-85236 Aug 26 11:13:32.739953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8e76c33-91b9-49a8-974e-594d555c4853 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:32.740519 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8e76c33-91b9-49a8-974e-594d555c4853 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:32.740949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8e76c33-91b9-49a8-974e-594d555c4853 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:32.744649 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-f1a0a24a-bf7d-4e56-8aa8-cb6c29f9a5ca req-59ed0239-4f7b-4869-bc8b-93ac3e840b17 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034366 Aug 26 11:13:32.745436 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 485/945] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:13:32.808217 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f8e76c33-91b9-49a8-974e-594d555c4853 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ea31e78ceb46f8bc92d86211da5072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef07a23929104d298d85485c33a0411e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:32.816761 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f8e76c33-91b9-49a8-974e-594d555c4853 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4" status: 200 len: 1297 microversion: 2.1 time: 0.091995 Aug 26 11:13:32.817344 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 461/946] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:32 2022] GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:13:33.839503 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b7754241-2d3f-4572-bbef-71b35030f532 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:33.840206 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b7754241-2d3f-4572-bbef-71b35030f532 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] [instance: 74e96e3e-0ce8-4787-8e91-0b2a656c27e4] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:33.847213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b7754241-2d3f-4572-bbef-71b35030f532 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:33.847690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b7754241-2d3f-4572-bbef-71b35030f532 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:33.848124 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b7754241-2d3f-4572-bbef-71b35030f532 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:33.848805 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b7754241-2d3f-4572-bbef-71b35030f532 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:33.849255 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b7754241-2d3f-4572-bbef-71b35030f532 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:33.849673 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b7754241-2d3f-4572-bbef-71b35030f532 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:33.864014 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-b7754241-2d3f-4572-bbef-71b35030f532 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] HTTP exception thrown: Instance 74e96e3e-0ce8-4787-8e91-0b2a656c27e4 could not be found. Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b7754241-2d3f-4572-bbef-71b35030f532 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Request method failure captured: Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 HTTP/1.1 Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKqzWzLN5kiy8Zi1jZ9FoLac40ssmc71zZGKp6NbYYyDyOfkrk7Yw2nGzXgcf6k5QGcBDWHATP5YF2RGdeRAFuyMMKafDX91U4nLH_JNPlUZTXHDobaLCt07WiLrek0u9gh1ZSBXGSbuQ5rtu9gJcDybllcGC4-Wv7SNCNjJWKoxMDY Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: ef07a23929104d298d85485c33a0411e Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-VolumesActionsTest-1698785244 Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:13:33.865715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:13:33.867613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ef07a23929104d298d85485c33a0411e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ef07a23929104d298d85485c33a0411e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef07a23929104d298d85485c33a0411e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef07a23929104d298d85485c33a0411e"}]}] Aug 26 11:13:33.867613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-VolumesActionsTest-1698785244 Aug 26 11:13:33.867613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: ef07a23929104d298d85485c33a0411e Aug 26 11:13:33.867613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-VolumesActionsTest-1698785244 Aug 26 11:13:33.867613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-VolumesActionsTest-1698785244-project Aug 26 11:13:33.867613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:13:33.867613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:13:33.867613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: b4ea31e78ceb46f8bc92d86211da5072 Aug 26 11:13:33.867613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-VolumesActionsTest-1698785244-project Aug 26 11:13:33.867613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:13:33.867613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance 74e96e3e-0ce8-4787-8e91-0b2a656c27e4 could not be found. Aug 26 11:13:33.867613 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': '74e96e3e-0ce8-4787-8e91-0b2a656c27e4'} Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74e96e3e-0ce8-4787-8e91-0b2a656c27e4 could not be found. Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:13:33.868538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74e96e3e-0ce8-4787-8e91-0b2a656c27e4 could not be found. Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74e96e3e-0ce8-4787-8e91-0b2a656c27e4 could not be found. Aug 26 11:13:33.869851 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:13:33.871541 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b7754241-2d3f-4572-bbef-71b35030f532 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] Returning 404 to user: Instance 74e96e3e-0ce8-4787-8e91-0b2a656c27e4 could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:13:33.871541 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b7754241-2d3f-4572-bbef-71b35030f532 tempest-VolumesActionsTest-1698785244 tempest-VolumesActionsTest-1698785244-project] 10.222.0.40 "GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4" status: 404 len: 111 microversion: 2.1 time: 0.032410 Aug 26 11:13:33.871541 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 486/947] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:33 2022] GET /compute/v2.1/servers/74e96e3e-0ce8-4787-8e91-0b2a656c27e4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:13:42.790771 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a5196b18-4525-4338-8743-2f50aa796dc1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:42.792688 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a5196b18-4525-4338-8743-2f50aa796dc1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:42.800037 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:42.806341 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5196b18-4525-4338-8743-2f50aa796dc1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:42.807052 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5196b18-4525-4338-8743-2f50aa796dc1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:42.807681 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5196b18-4525-4338-8743-2f50aa796dc1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:42.808486 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5196b18-4525-4338-8743-2f50aa796dc1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:42.809045 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5196b18-4525-4338-8743-2f50aa796dc1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:42.810220 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5196b18-4525-4338-8743-2f50aa796dc1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:42.840421 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:42.856260 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a5196b18-4525-4338-8743-2f50aa796dc1 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01/ips" status: 200 len: 149 microversion: 2.1 time: 0.073496 Aug 26 11:13:42.858167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 462/948] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 11:13:42 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01/ips => generated 149 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:13:44.308394 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-599e7895-624e-4b0a-9a96-72b7d9dd1390 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebf599ec-cf44-4bda-8933-de4763ffa613"}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:13:44.312956 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-599e7895-624e-4b0a-9a96-72b7d9dd1390 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:44.319583 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:44.321165 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=9 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:13:44.324640 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-599e7895-624e-4b0a-9a96-72b7d9dd1390 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:44.325541 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-599e7895-624e-4b0a-9a96-72b7d9dd1390 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:44.326252 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-599e7895-624e-4b0a-9a96-72b7d9dd1390 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:44.327205 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-599e7895-624e-4b0a-9a96-72b7d9dd1390 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:44.327867 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-599e7895-624e-4b0a-9a96-72b7d9dd1390 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:44.328498 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-599e7895-624e-4b0a-9a96-72b7d9dd1390 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:44.711828 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-599e7895-624e-4b0a-9a96-72b7d9dd1390 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "POST /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407228 Aug 26 11:13:44.712950 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 487/949] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 11:13:44 2022] POST /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:13:52.440912 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4cd63fa7-9f40-4de4-acb4-1824bae865fb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebf599ec-cf44-4bda-8933-de4763ffa613"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:13:52.443942 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4cd63fa7-9f40-4de4-acb4-1824bae865fb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:52.453547 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cd63fa7-9f40-4de4-acb4-1824bae865fb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:52.454323 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cd63fa7-9f40-4de4-acb4-1824bae865fb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:52.454944 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cd63fa7-9f40-4de4-acb4-1824bae865fb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:52.457296 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cd63fa7-9f40-4de4-acb4-1824bae865fb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:52.458426 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cd63fa7-9f40-4de4-acb4-1824bae865fb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:52.459602 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cd63fa7-9f40-4de4-acb4-1824bae865fb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:52.596565 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-4cd63fa7-9f40-4de4-acb4-1824bae865fb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] HTTP exception thrown: Invalid volume: volume ebf599ec-cf44-4bda-8933-de4763ffa613 is already attached to instances: c0e78763-5fe6-49aa-9aaa-f609e352fe01 Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4cd63fa7-9f40-4de4-acb4-1824bae865fb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Request method failure captured: Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: POST /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01/os-volume_attachments HTTP/1.1 Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 74 Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKoS760bbZGFLZIOtz0bKN10taydUPpuaCKVzX6gMaWx7hZAZTvcJMm_yZoNCB5lp_e9MQjhaY7MeAuvI46fhuwxrStFhmWy1UiPbfomblZkYtULFDPdpOJqpKIXIq_HGXEQgCHtVLesHEPgZPUJF6lSZ6rQfXeWj1bDY2Cb8a6cLCs Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:13:52.599063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:13:52.600625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}] Aug 26 11:13:52.600625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:13:52.600625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:13:52.600625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:13:52.600625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:13:52.600625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:13:52.600625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:13:52.600625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 85716f53e88048af9a8fdcbe4415979c Aug 26 11:13:52.600625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:13:52.600625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Aug 26 11:13:52.600625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {"volumeAttachment": {"volumeId": "ebf599ec-cf44-4bda-8933-de4763ffa613"}} Aug 26 11:13:52.600625 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Invalid volume: volume ebf599ec-cf44-4bda-8933-de4763ffa613 is already attached to instances: c0e78763-5fe6-49aa-9aaa-f609e352fe01 Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'server_id': 'c0e78763-5fe6-49aa-9aaa-f609e352fe01', 'body': {'volumeAttachment': {'volumeId': 'ebf599ec-cf44-4bda-8933-de4763ffa613'}}} Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ebf599ec-cf44-4bda-8933-de4763ffa613 is already attached to instances: c0e78763-5fe6-49aa-9aaa-f609e352fe01 Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:52.601434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ebf599ec-cf44-4bda-8933-de4763ffa613 is already attached to instances: c0e78763-5fe6-49aa-9aaa-f609e352fe01 Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:13:52.603968 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:13:52.605673 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:13:52.605673 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:13:52.605673 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:13:52.605673 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ebf599ec-cf44-4bda-8933-de4763ffa613 is already attached to instances: c0e78763-5fe6-49aa-9aaa-f609e352fe01 Aug 26 11:13:52.605673 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:52.605673 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4cd63fa7-9f40-4de4-acb4-1824bae865fb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Returning 400 to user: Invalid volume: volume ebf599ec-cf44-4bda-8933-de4763ffa613 is already attached to instances: c0e78763-5fe6-49aa-9aaa-f609e352fe01 {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:13:52.605673 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4cd63fa7-9f40-4de4-acb4-1824bae865fb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "POST /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.167101 Aug 26 11:13:52.605673 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 463/950] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 11:13:52 2022] POST /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01/os-volume_attachments => generated 174 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 11:13:52.714453 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5093103c-8538-4d88-afb7-868d545ad845 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:52.716687 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5093103c-8538-4d88-afb7-868d545ad845 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:52.728611 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5093103c-8538-4d88-afb7-868d545ad845 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:52.729597 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5093103c-8538-4d88-afb7-868d545ad845 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:52.730553 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5093103c-8538-4d88-afb7-868d545ad845 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:52.732085 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5093103c-8538-4d88-afb7-868d545ad845 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:52.733536 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5093103c-8538-4d88-afb7-868d545ad845 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:52.734596 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5093103c-8538-4d88-afb7-868d545ad845 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:52.865706 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-5093103c-8538-4d88-afb7-868d545ad845 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lazy-loading 'services' on Instance uuid c0e78763-5fe6-49aa-9aaa-f609e352fe01 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:13:52.960131 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5093103c-8538-4d88-afb7-868d545ad845 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01/os-volume_attachments/ebf599ec-cf44-4bda-8933-de4763ffa613" status: 202 len: 0 microversion: 2.1 time: 0.253031 Aug 26 11:13:52.960917 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 488/951] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 11:13:52 2022] DELETE /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01/os-volume_attachments/ebf599ec-cf44-4bda-8933-de4763ffa613 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:13:52.971516 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-97e5e678-57e4-4b35-9b61-b8c6fcc502d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:52.974701 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-97e5e678-57e4-4b35-9b61-b8c6fcc502d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:52.983094 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-97e5e678-57e4-4b35-9b61-b8c6fcc502d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:52.984181 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-97e5e678-57e4-4b35-9b61-b8c6fcc502d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:52.985123 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-97e5e678-57e4-4b35-9b61-b8c6fcc502d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:52.986014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-97e5e678-57e4-4b35-9b61-b8c6fcc502d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:52.987319 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-97e5e678-57e4-4b35-9b61-b8c6fcc502d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:52.987848 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-97e5e678-57e4-4b35-9b61-b8c6fcc502d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:53.033301 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-97e5e678-57e4-4b35-9b61-b8c6fcc502d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067537 Aug 26 11:13:53.033953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 464/952] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:13:52 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:13:54.050307 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-840c76af-83da-4a9e-b785-5119e39f5a14 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:54.052808 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-840c76af-83da-4a9e-b785-5119e39f5a14 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:54.061094 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-840c76af-83da-4a9e-b785-5119e39f5a14 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:54.061588 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-840c76af-83da-4a9e-b785-5119e39f5a14 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:54.062068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-840c76af-83da-4a9e-b785-5119e39f5a14 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:54.062789 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-840c76af-83da-4a9e-b785-5119e39f5a14 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:54.063302 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-840c76af-83da-4a9e-b785-5119e39f5a14 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:54.063725 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-840c76af-83da-4a9e-b785-5119e39f5a14 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:54.098075 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-840c76af-83da-4a9e-b785-5119e39f5a14 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053665 Aug 26 11:13:54.098652 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 489/953] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:13:54 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 11:13:54.164399 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-68d9253b-91d7-4ce3-8590-3d6d6bd355ff tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:54.164881 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-68d9253b-91d7-4ce3-8590-3d6d6bd355ff tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:54.171686 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68d9253b-91d7-4ce3-8590-3d6d6bd355ff tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:54.172167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68d9253b-91d7-4ce3-8590-3d6d6bd355ff tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:54.172599 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68d9253b-91d7-4ce3-8590-3d6d6bd355ff tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:54.173297 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68d9253b-91d7-4ce3-8590-3d6d6bd355ff tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:54.173745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68d9253b-91d7-4ce3-8590-3d6d6bd355ff tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:54.174199 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68d9253b-91d7-4ce3-8590-3d6d6bd355ff tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:54.211161 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-68d9253b-91d7-4ce3-8590-3d6d6bd355ff tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:13:54.296141 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-68d9253b-91d7-4ce3-8590-3d6d6bd355ff tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 204 len: 0 microversion: 2.1 time: 0.135480 Aug 26 11:13:54.296722 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 465/954] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:13:54 2022] DELETE /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:13:54.305007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-63e1b4d3-6288-4ec2-a857-a4f533a2ecf6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:54.305632 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-63e1b4d3-6288-4ec2-a857-a4f533a2ecf6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:54.312423 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-63e1b4d3-6288-4ec2-a857-a4f533a2ecf6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:54.312908 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-63e1b4d3-6288-4ec2-a857-a4f533a2ecf6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:54.313338 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-63e1b4d3-6288-4ec2-a857-a4f533a2ecf6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:54.314044 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-63e1b4d3-6288-4ec2-a857-a4f533a2ecf6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:54.314518 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-63e1b4d3-6288-4ec2-a857-a4f533a2ecf6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:54.314911 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-63e1b4d3-6288-4ec2-a857-a4f533a2ecf6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:54.461089 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-63e1b4d3-6288-4ec2-a857-a4f533a2ecf6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:54.470232 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-63e1b4d3-6288-4ec2-a857-a4f533a2ecf6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1682 microversion: 2.1 time: 0.169032 Aug 26 11:13:54.471064 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 490/955] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:54 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:55.493078 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f69b9442-2a46-46eb-a6b3-7cd5aa5e711f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:55.493783 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f69b9442-2a46-46eb-a6b3-7cd5aa5e711f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:55.501070 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f69b9442-2a46-46eb-a6b3-7cd5aa5e711f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:55.501565 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f69b9442-2a46-46eb-a6b3-7cd5aa5e711f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:55.502029 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f69b9442-2a46-46eb-a6b3-7cd5aa5e711f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:55.502880 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f69b9442-2a46-46eb-a6b3-7cd5aa5e711f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:55.503352 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f69b9442-2a46-46eb-a6b3-7cd5aa5e711f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:55.503922 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f69b9442-2a46-46eb-a6b3-7cd5aa5e711f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:55.657113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f69b9442-2a46-46eb-a6b3-7cd5aa5e711f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:55.666740 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f69b9442-2a46-46eb-a6b3-7cd5aa5e711f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1682 microversion: 2.1 time: 0.177303 Aug 26 11:13:55.667013 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 466/956] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:55 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:56.688655 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b8d07a9e-f4c3-42b4-8f47-c4f31acd7cd4 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:56.689253 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b8d07a9e-f4c3-42b4-8f47-c4f31acd7cd4 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:56.696122 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b8d07a9e-f4c3-42b4-8f47-c4f31acd7cd4 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:56.696609 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b8d07a9e-f4c3-42b4-8f47-c4f31acd7cd4 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:56.697042 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b8d07a9e-f4c3-42b4-8f47-c4f31acd7cd4 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:56.697747 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b8d07a9e-f4c3-42b4-8f47-c4f31acd7cd4 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:56.698224 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b8d07a9e-f4c3-42b4-8f47-c4f31acd7cd4 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:56.698648 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b8d07a9e-f4c3-42b4-8f47-c4f31acd7cd4 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:56.864230 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b8d07a9e-f4c3-42b4-8f47-c4f31acd7cd4 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:56.879465 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b8d07a9e-f4c3-42b4-8f47-c4f31acd7cd4 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1682 microversion: 2.1 time: 0.195077 Aug 26 11:13:56.880103 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 491/957] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:56 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1682 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:57.339277 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-e13b7940-f895-4496-a226-7e2a588eda15 req-c427f83d-893f-44b5-90c0-ab5d43417e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e78763-5fe6-49aa-9aaa-f609e352fe01", "name": "network-vif-deleted", "tag": "320957d2-f8f3-4863-963f-45200e182701"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:13:57.354914 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e13b7940-f895-4496-a226-7e2a588eda15 req-c427f83d-893f-44b5-90c0-ab5d43417e81 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:57.355837 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e13b7940-f895-4496-a226-7e2a588eda15 req-c427f83d-893f-44b5-90c0-ab5d43417e81 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:57.356716 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e13b7940-f895-4496-a226-7e2a588eda15 req-c427f83d-893f-44b5-90c0-ab5d43417e81 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:57.379033 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-e13b7940-f895-4496-a226-7e2a588eda15 req-c427f83d-893f-44b5-90c0-ab5d43417e81 service nova] Creating event network-vif-deleted:320957d2-f8f3-4863-963f-45200e182701 for instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 on hv-cinder-85236 Aug 26 11:13:57.385544 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-e13b7940-f895-4496-a226-7e2a588eda15 req-c427f83d-893f-44b5-90c0-ab5d43417e81 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049873 Aug 26 11:13:57.392681 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 467/958] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:13:57.905166 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-6bea7d5a-fea4-4aae-abbe-c27837bac77c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:57.906191 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-6bea7d5a-fea4-4aae-abbe-c27837bac77c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:57.914578 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6bea7d5a-fea4-4aae-abbe-c27837bac77c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:57.915338 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6bea7d5a-fea4-4aae-abbe-c27837bac77c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:57.915782 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6bea7d5a-fea4-4aae-abbe-c27837bac77c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:57.916495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6bea7d5a-fea4-4aae-abbe-c27837bac77c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:57.917124 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6bea7d5a-fea4-4aae-abbe-c27837bac77c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:57.917559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6bea7d5a-fea4-4aae-abbe-c27837bac77c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:57.955192 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6bea7d5a-fea4-4aae-abbe-c27837bac77c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:57.955957 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6bea7d5a-fea4-4aae-abbe-c27837bac77c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:57.956771 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6bea7d5a-fea4-4aae-abbe-c27837bac77c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:57.958153 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-6bea7d5a-fea4-4aae-abbe-c27837bac77c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lazy-loading 'fault' on Instance uuid c0e78763-5fe6-49aa-9aaa-f609e352fe01 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:13:58.019609 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6bea7d5a-fea4-4aae-abbe-c27837bac77c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:13:58.035097 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-6bea7d5a-fea4-4aae-abbe-c27837bac77c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 200 len: 1332 microversion: 2.1 time: 0.137851 Aug 26 11:13:58.036281 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 492/959] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:57 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 1332 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:13:59.057757 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-624b33f4-5f8e-4361-978d-4c4d09a11e5c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:59.058565 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-624b33f4-5f8e-4361-978d-4c4d09a11e5c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:13:59.065602 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-624b33f4-5f8e-4361-978d-4c4d09a11e5c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:59.066189 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-624b33f4-5f8e-4361-978d-4c4d09a11e5c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:59.066577 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-624b33f4-5f8e-4361-978d-4c4d09a11e5c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:59.067402 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-624b33f4-5f8e-4361-978d-4c4d09a11e5c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:13:59.067738 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-624b33f4-5f8e-4361-978d-4c4d09a11e5c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:13:59.068166 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-624b33f4-5f8e-4361-978d-4c4d09a11e5c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:13:59.082213 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-624b33f4-5f8e-4361-978d-4c4d09a11e5c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] HTTP exception thrown: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-624b33f4-5f8e-4361-978d-4c4d09a11e5c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Request method failure captured: Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 HTTP/1.1 Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKoS760bbZGFLZIOtz0bKN10taydUPpuaCKVzX6gMaWx7hZAZTvcJMm_yZoNCB5lp_e9MQjhaY7MeAuvI46fhuwxrStFhmWy1UiPbfomblZkYtULFDPdpOJqpKIXIq_HGXEQgCHtVLesHEPgZPUJF6lSZ6rQfXeWj1bDY2Cb8a6cLCs Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:13:59.083948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:13:59.085690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}] Aug 26 11:13:59.085690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:13:59.085690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:13:59.085690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:13:59.085690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:13:59.085690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:13:59.085690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:13:59.085690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 85716f53e88048af9a8fdcbe4415979c Aug 26 11:13:59.085690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:13:59.085690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:13:59.085690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. Aug 26 11:13:59.085690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'c0e78763-5fe6-49aa-9aaa-f609e352fe01'} Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:13:59.086611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. Aug 26 11:13:59.088392 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:13:59.089748 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-624b33f4-5f8e-4361-978d-4c4d09a11e5c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Returning 404 to user: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:13:59.089748 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-624b33f4-5f8e-4361-978d-4c4d09a11e5c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 404 len: 111 microversion: 2.1 time: 0.032595 Aug 26 11:13:59.089748 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 468/960] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:13:59 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 11:13:59.095604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-8a5699dc-be3d-4ed4-958c-55abb67fcbb0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '.version_select at 0x7f1a68a673a0>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:13:59.118616 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-8a5699dc-be3d-4ed4-958c-55abb67fcbb0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311972575" status: 202 len: 0 microversion: 2.1 time: 0.027377 Aug 26 11:13:59.119318 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 493/961] 10.222.0.40 () {58 vars in 1221 bytes} [Fri Aug 26 11:13:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311972575 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:13:59.842313 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-97ba0d63-3684-4ac5-9264-11e21425c587 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Action: 'create', calling method: .version_select at 0x7f1a688f6790>, body: {"keypair": {"name": "tempest-keypair-1936257624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsmripK2n7o16/UhCKiMH5OxMdOMy9YbfBv8N3bywuGVMER48Oc6QK1ou4vh2MivM+nj93rkeG1HSc2ZgsNBCyf57P37Bh8QheTfUsHn67w1KAPAmjmY8/Fa2TBW0cA4g=="}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:13:59.858101 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-97ba0d63-3684-4ac5-9264-11e21425c587 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Getting quotas for project f780402b93f94d26b2fceab83c0bf485. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:13:59.862319 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-97ba0d63-3684-4ac5-9264-11e21425c587 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Getting quotas for user 85716f53e88048af9a8fdcbe4415979c and project f780402b93f94d26b2fceab83c0bf485. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:13:59.886566 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-97ba0d63-3684-4ac5-9264-11e21425c587 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048800 Aug 26 11:13:59.887151 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 469/962] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 11:13:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:14:01.297789 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-461578718", "imageRef": "55393b9f-3590-4ac4-9610-afb8c619d683", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad797925-a966-4b56-98aa-95c1629b07a2"}], "security_groups": [{"name": "tempest-securitygroup--860631538"}], "key_name": "tempest-keypair-1936257624", "user_data": "}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:14:01.405826 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.network.neutron [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] validate_networks() for [('ad797925-a966-4b56-98aa-95c1629b07a2', None, None, None, None, None)] {{(pid=120605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:14:01.801211 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Flavor limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:14:01.801636 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Image limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:14:01.802152 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Flavor pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:14:01.802565 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Image pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:14:01.802980 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:14:01.814266 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:01.814747 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:01.815179 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:01.815898 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:01.816351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:01.816771 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:01.834306 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Getting quotas for project f780402b93f94d26b2fceab83c0bf485. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:14:01.838242 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Getting quotas for user 85716f53e88048af9a8fdcbe4415979c and project f780402b93f94d26b2fceab83c0bf485. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:14:01.849314 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Going to run 1 instances... {{(pid=120605) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:14:01.851651 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='55393b9f-3590-4ac4-9610-afb8c619d683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:14:01.908293 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-e284f060-3282-4c6e-a9ef-272eaca4a225 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.616211 Aug 26 11:14:01.908940 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 494/963] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:14:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:14:01.921345 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-773ad5ca-22c9-4478-bf5b-80272ff2f999 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:14:01.922132 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-773ad5ca-22c9-4478-bf5b-80272ff2f999 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:14:01.978027 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-773ad5ca-22c9-4478-bf5b-80272ff2f999 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:14:01.985764 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-773ad5ca-22c9-4478-bf5b-80272ff2f999 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 200 len: 1241 microversion: 2.1 time: 0.069490 Aug 26 11:14:01.986362 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 470/964] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:14:01 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:14:03.009088 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-59c5f33c-c1bb-43a7-95fa-39bc6723f1eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:14:03.010235 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-59c5f33c-c1bb-43a7-95fa-39bc6723f1eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:14:03.021410 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-59c5f33c-c1bb-43a7-95fa-39bc6723f1eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:03.022220 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-59c5f33c-c1bb-43a7-95fa-39bc6723f1eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:03.022776 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-59c5f33c-c1bb-43a7-95fa-39bc6723f1eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:03.023804 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-59c5f33c-c1bb-43a7-95fa-39bc6723f1eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:03.024462 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-59c5f33c-c1bb-43a7-95fa-39bc6723f1eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:03.025036 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-59c5f33c-c1bb-43a7-95fa-39bc6723f1eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:03.095214 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-59c5f33c-c1bb-43a7-95fa-39bc6723f1eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:14:03.104373 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-59c5f33c-c1bb-43a7-95fa-39bc6723f1eb tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 200 len: 1301 microversion: 2.1 time: 0.101564 Aug 26 11:14:03.111990 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 495/965] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:14:03 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 1301 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:14:04.129574 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c0e67efc-dd57-4988-9c4f-e0ab63d57f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:14:04.130327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c0e67efc-dd57-4988-9c4f-e0ab63d57f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:14:04.138767 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c0e67efc-dd57-4988-9c4f-e0ab63d57f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:04.139901 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c0e67efc-dd57-4988-9c4f-e0ab63d57f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:04.140412 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c0e67efc-dd57-4988-9c4f-e0ab63d57f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:04.141307 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c0e67efc-dd57-4988-9c4f-e0ab63d57f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:04.141768 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c0e67efc-dd57-4988-9c4f-e0ab63d57f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:04.142264 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c0e67efc-dd57-4988-9c4f-e0ab63d57f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:04.315652 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c0e67efc-dd57-4988-9c4f-e0ab63d57f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:14:04.324752 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c0e67efc-dd57-4988-9c4f-e0ab63d57f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 200 len: 1366 microversion: 2.1 time: 0.201124 Aug 26 11:14:04.325688 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 471/966] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:14:04 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:14:04.623210 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-d919f215-622a-49b5-9b1a-b680ce20d922 req-5d8b166b-090c-4560-b874-fdbdeefd055b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9b10c0f-0618-466b-834f-1041854727f7", "tag": "49da4d2c-f694-4df3-9b1c-3b441f4f950e"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:14:04.640761 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-d919f215-622a-49b5-9b1a-b680ce20d922 req-5d8b166b-090c-4560-b874-fdbdeefd055b service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:04.641598 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-d919f215-622a-49b5-9b1a-b680ce20d922 req-5d8b166b-090c-4560-b874-fdbdeefd055b service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:04.642272 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-d919f215-622a-49b5-9b1a-b680ce20d922 req-5d8b166b-090c-4560-b874-fdbdeefd055b service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:04.657175 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-d919f215-622a-49b5-9b1a-b680ce20d922 req-5d8b166b-090c-4560-b874-fdbdeefd055b service nova] Creating event network-changed:49da4d2c-f694-4df3-9b1c-3b441f4f950e for instance d9b10c0f-0618-466b-834f-1041854727f7 on hv-cinder-85236 Aug 26 11:14:04.664043 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-d919f215-622a-49b5-9b1a-b680ce20d922 req-5d8b166b-090c-4560-b874-fdbdeefd055b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048656 Aug 26 11:14:04.666163 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 496/967] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:14:05.351203 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ec210bfd-639c-4af4-a764-c7da02f07cd7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:14:05.352102 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ec210bfd-639c-4af4-a764-c7da02f07cd7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:14:05.360915 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec210bfd-639c-4af4-a764-c7da02f07cd7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:05.361404 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec210bfd-639c-4af4-a764-c7da02f07cd7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:05.361837 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec210bfd-639c-4af4-a764-c7da02f07cd7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:05.362582 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec210bfd-639c-4af4-a764-c7da02f07cd7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:05.363215 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec210bfd-639c-4af4-a764-c7da02f07cd7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:05.363643 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec210bfd-639c-4af4-a764-c7da02f07cd7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:05.510363 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ec210bfd-639c-4af4-a764-c7da02f07cd7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:14:05.519007 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ec210bfd-639c-4af4-a764-c7da02f07cd7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 200 len: 1366 microversion: 2.1 time: 0.171793 Aug 26 11:14:05.519575 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 472/968] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:14:05 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:14:06.541003 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-aa90283c-28a5-4faa-8965-379eae112dde tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:14:06.541610 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-aa90283c-28a5-4faa-8965-379eae112dde tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:14:06.548894 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aa90283c-28a5-4faa-8965-379eae112dde tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:06.549376 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aa90283c-28a5-4faa-8965-379eae112dde tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:06.549812 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aa90283c-28a5-4faa-8965-379eae112dde tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:06.550548 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aa90283c-28a5-4faa-8965-379eae112dde tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:06.550993 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aa90283c-28a5-4faa-8965-379eae112dde tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:06.551548 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aa90283c-28a5-4faa-8965-379eae112dde tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:06.691729 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-aa90283c-28a5-4faa-8965-379eae112dde tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:14:06.699947 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-aa90283c-28a5-4faa-8965-379eae112dde tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 200 len: 1366 microversion: 2.1 time: 0.163585 Aug 26 11:14:06.700934 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 497/969] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:14:06 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:14:07.722385 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0a6ea257-431d-43cd-9eb7-42926a5741ce tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:14:07.723055 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0a6ea257-431d-43cd-9eb7-42926a5741ce tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:14:07.729557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a6ea257-431d-43cd-9eb7-42926a5741ce tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:07.730075 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a6ea257-431d-43cd-9eb7-42926a5741ce tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:07.730518 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a6ea257-431d-43cd-9eb7-42926a5741ce tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:07.731836 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a6ea257-431d-43cd-9eb7-42926a5741ce tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:07.732288 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a6ea257-431d-43cd-9eb7-42926a5741ce tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:07.732714 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a6ea257-431d-43cd-9eb7-42926a5741ce tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:07.876741 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0a6ea257-431d-43cd-9eb7-42926a5741ce tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:14:07.884576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0a6ea257-431d-43cd-9eb7-42926a5741ce tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 200 len: 1366 microversion: 2.1 time: 0.166054 Aug 26 11:14:07.885146 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 473/970] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:14:07 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:14:08.906876 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-1e15e6cb-b876-4ef7-9c7e-8d129053fc38 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:14:08.907476 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-1e15e6cb-b876-4ef7-9c7e-8d129053fc38 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:14:08.914250 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1e15e6cb-b876-4ef7-9c7e-8d129053fc38 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:08.914840 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1e15e6cb-b876-4ef7-9c7e-8d129053fc38 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:08.917193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1e15e6cb-b876-4ef7-9c7e-8d129053fc38 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:08.917193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1e15e6cb-b876-4ef7-9c7e-8d129053fc38 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:08.917193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1e15e6cb-b876-4ef7-9c7e-8d129053fc38 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:08.917193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-1e15e6cb-b876-4ef7-9c7e-8d129053fc38 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:09.052918 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-1e15e6cb-b876-4ef7-9c7e-8d129053fc38 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:14:09.061427 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-1e15e6cb-b876-4ef7-9c7e-8d129053fc38 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 200 len: 1366 microversion: 2.1 time: 0.159792 Aug 26 11:14:09.062013 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 498/971] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:14:08 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:14:10.082060 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3ca1de7c-4e4e-4a15-a63c-9dd1b25dd451 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:14:10.082726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3ca1de7c-4e4e-4a15-a63c-9dd1b25dd451 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:14:10.089325 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ca1de7c-4e4e-4a15-a63c-9dd1b25dd451 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:10.089835 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ca1de7c-4e4e-4a15-a63c-9dd1b25dd451 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:10.090296 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ca1de7c-4e4e-4a15-a63c-9dd1b25dd451 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:10.090987 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ca1de7c-4e4e-4a15-a63c-9dd1b25dd451 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:10.091434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ca1de7c-4e4e-4a15-a63c-9dd1b25dd451 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:10.091849 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ca1de7c-4e4e-4a15-a63c-9dd1b25dd451 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:10.217209 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-63cc0b20-3f1f-49c3-abbf-53b0de9ce043 req-ad4b7228-0701-4775-9003-47faa8eb7442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b10c0f-0618-466b-834f-1041854727f7", "name": "network-vif-plugged", "status": "completed", "tag": "49da4d2c-f694-4df3-9b1c-3b441f4f950e"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:14:10.225802 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3ca1de7c-4e4e-4a15-a63c-9dd1b25dd451 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:14:10.227715 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-63cc0b20-3f1f-49c3-abbf-53b0de9ce043 req-ad4b7228-0701-4775-9003-47faa8eb7442 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:10.228193 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-63cc0b20-3f1f-49c3-abbf-53b0de9ce043 req-ad4b7228-0701-4775-9003-47faa8eb7442 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:10.228889 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-63cc0b20-3f1f-49c3-abbf-53b0de9ce043 req-ad4b7228-0701-4775-9003-47faa8eb7442 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:10.236923 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3ca1de7c-4e4e-4a15-a63c-9dd1b25dd451 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 200 len: 1366 microversion: 2.1 time: 0.158707 Aug 26 11:14:10.238021 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 474/972] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:14:10 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:14:10.241370 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-63cc0b20-3f1f-49c3-abbf-53b0de9ce043 req-ad4b7228-0701-4775-9003-47faa8eb7442 service nova] Creating event network-vif-plugged:49da4d2c-f694-4df3-9b1c-3b441f4f950e for instance d9b10c0f-0618-466b-834f-1041854727f7 on hv-cinder-85236 Aug 26 11:14:10.246329 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-63cc0b20-3f1f-49c3-abbf-53b0de9ce043 req-ad4b7228-0701-4775-9003-47faa8eb7442 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033646 Aug 26 11:14:10.247092 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 499/973] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:14:11.258805 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-36edd279-f079-489e-998c-38fffb422bb7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:14:11.259338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-36edd279-f079-489e-998c-38fffb422bb7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:14:11.267082 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36edd279-f079-489e-998c-38fffb422bb7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:11.267560 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36edd279-f079-489e-998c-38fffb422bb7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:11.267990 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36edd279-f079-489e-998c-38fffb422bb7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:11.268684 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36edd279-f079-489e-998c-38fffb422bb7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:11.269128 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36edd279-f079-489e-998c-38fffb422bb7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:11.269770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36edd279-f079-489e-998c-38fffb422bb7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:11.403871 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-36edd279-f079-489e-998c-38fffb422bb7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:14:11.411679 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-36edd279-f079-489e-998c-38fffb422bb7 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 200 len: 1366 microversion: 2.1 time: 0.156784 Aug 26 11:14:11.412253 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 475/974] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:14:11 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:14:12.430489 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:14:12.431164 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=6 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:14:12.435672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-9ebac018-843d-4bd3-94ea-101957fe6317 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:14:12.436371 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-9ebac018-843d-4bd3-94ea-101957fe6317 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:14:12.443471 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9ebac018-843d-4bd3-94ea-101957fe6317 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:12.443954 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9ebac018-843d-4bd3-94ea-101957fe6317 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:12.444389 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9ebac018-843d-4bd3-94ea-101957fe6317 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:12.445078 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9ebac018-843d-4bd3-94ea-101957fe6317 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:12.445526 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9ebac018-843d-4bd3-94ea-101957fe6317 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:12.445944 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-9ebac018-843d-4bd3-94ea-101957fe6317 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:12.582535 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-9ebac018-843d-4bd3-94ea-101957fe6317 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:14:12.590927 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-9ebac018-843d-4bd3-94ea-101957fe6317 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 200 len: 1555 microversion: 2.1 time: 0.161920 Aug 26 11:14:12.592142 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 500/975] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:14:12 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:14:12.612734 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-de574d67-4ded-44c9-b45f-0a1fea4a2ab6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:14:12.613282 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-de574d67-4ded-44c9-b45f-0a1fea4a2ab6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:14:12.615309 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=6 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:14:12.620991 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de574d67-4ded-44c9-b45f-0a1fea4a2ab6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:12.621474 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de574d67-4ded-44c9-b45f-0a1fea4a2ab6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:12.621902 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de574d67-4ded-44c9-b45f-0a1fea4a2ab6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:12.622629 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de574d67-4ded-44c9-b45f-0a1fea4a2ab6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:12.623081 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de574d67-4ded-44c9-b45f-0a1fea4a2ab6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:12.623497 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-de574d67-4ded-44c9-b45f-0a1fea4a2ab6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:12.703622 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-de574d67-4ded-44c9-b45f-0a1fea4a2ab6 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094067 Aug 26 11:14:12.704060 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 476/976] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 26 11:14:12 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:14:13.939894 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-9affaa50-b0a2-442e-9f3c-2162d71d629a req-eead780e-ee32-401e-bea3-aa8256113365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9b10c0f-0618-466b-834f-1041854727f7", "tag": "49da4d2c-f694-4df3-9b1c-3b441f4f950e"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:14:13.949809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-9affaa50-b0a2-442e-9f3c-2162d71d629a req-eead780e-ee32-401e-bea3-aa8256113365 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:13.950324 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-9affaa50-b0a2-442e-9f3c-2162d71d629a req-eead780e-ee32-401e-bea3-aa8256113365 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:13.950755 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-9affaa50-b0a2-442e-9f3c-2162d71d629a req-eead780e-ee32-401e-bea3-aa8256113365 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:13.963269 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-9affaa50-b0a2-442e-9f3c-2162d71d629a req-eead780e-ee32-401e-bea3-aa8256113365 service nova] Creating event network-changed:49da4d2c-f694-4df3-9b1c-3b441f4f950e for instance d9b10c0f-0618-466b-834f-1041854727f7 on hv-cinder-85236 Aug 26 11:14:13.968875 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-9affaa50-b0a2-442e-9f3c-2162d71d629a req-eead780e-ee32-401e-bea3-aa8256113365 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039504 Aug 26 11:14:13.969900 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 501/977] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:14:58.866386 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3f915211-f1c3-4374-bbb9-26149fc31b8c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:14:58.866956 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3f915211-f1c3-4374-bbb9-26149fc31b8c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:14:58.875292 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:14:58.876974 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:14:58.880290 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f915211-f1c3-4374-bbb9-26149fc31b8c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:58.881110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f915211-f1c3-4374-bbb9-26149fc31b8c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:58.881999 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f915211-f1c3-4374-bbb9-26149fc31b8c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:58.883556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f915211-f1c3-4374-bbb9-26149fc31b8c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:14:58.885404 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f915211-f1c3-4374-bbb9-26149fc31b8c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:14:58.886096 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f915211-f1c3-4374-bbb9-26149fc31b8c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:14:58.928602 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3f915211-f1c3-4374-bbb9-26149fc31b8c tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7/ips" status: 200 len: 148 microversion: 2.1 time: 0.070504 Aug 26 11:14:58.929618 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 477/978] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 11:14:58 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7/ips => generated 148 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:14:59.588730 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:14:59.590234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:14:59.819524 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-935fa8b3-f7db-4ec6-ac63-b8237302de56 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Action: 'create', calling method: .version_select at 0x7f1a6894c310>, body: {"keypair": {"name": "tempest-TestShelveInstance-373540222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2yXeAkWcGEe9oQs50tkv08CZ9aQPR/sqtk0vBCNWH+3LDOsG0G9thUePDceTh0e1oQ62B8UQvH39Q5rZ0latrXyVnqF+IQVL2OYJZmo66NsrjvzYNRuO8Rr0znReNeMw=="}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:14:59.836495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-935fa8b3-f7db-4ec6-ac63-b8237302de56 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Getting quotas for project 3d84157876f945099fda5fcb9d3f6c20. Resources: {'key_pairs'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:14:59.840503 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-935fa8b3-f7db-4ec6-ac63-b8237302de56 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Getting quotas for user 93bec07110aa4697ab59ced454a51f9a and project 3d84157876f945099fda5fcb9d3f6c20. Resources: {'key_pairs'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:14:59.866660 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-935fa8b3-f7db-4ec6-ac63-b8237302de56 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.279608 Aug 26 11:14:59.867263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 502/979] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 11:14:59 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:15:00.491303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-882eb4d8-b3f7-480f-a3cf-f377a277ca3e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ef78338-2990-4ff8-bdb5-ee08d96c0e49"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:15:00.495201 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-882eb4d8-b3f7-480f-a3cf-f377a277ca3e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:00.505356 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-882eb4d8-b3f7-480f-a3cf-f377a277ca3e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:00.506283 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-882eb4d8-b3f7-480f-a3cf-f377a277ca3e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:00.506796 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-882eb4d8-b3f7-480f-a3cf-f377a277ca3e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:00.507795 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-882eb4d8-b3f7-480f-a3cf-f377a277ca3e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:00.508282 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-882eb4d8-b3f7-480f-a3cf-f377a277ca3e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:00.508708 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-882eb4d8-b3f7-480f-a3cf-f377a277ca3e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:00.966454 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-882eb4d8-b3f7-480f-a3cf-f377a277ca3e tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "POST /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.479368 Aug 26 11:15:00.973191 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 478/980] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 11:15:00 2022] POST /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7/os-volume_attachments => generated 194 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:15:08.689743 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5efc21e0-dd81-47f3-be27-fc99856f4f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:08.690398 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5efc21e0-dd81-47f3-be27-fc99856f4f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:08.700258 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5efc21e0-dd81-47f3-be27-fc99856f4f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:08.700757 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5efc21e0-dd81-47f3-be27-fc99856f4f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:08.701199 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5efc21e0-dd81-47f3-be27-fc99856f4f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:08.701949 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5efc21e0-dd81-47f3-be27-fc99856f4f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:08.702432 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5efc21e0-dd81-47f3-be27-fc99856f4f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:08.702884 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5efc21e0-dd81-47f3-be27-fc99856f4f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:08.848081 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.objects.instance [None req-5efc21e0-dd81-47f3-be27-fc99856f4f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lazy-loading 'services' on Instance uuid d9b10c0f-0618-466b-834f-1041854727f7 {{(pid=120605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:15:08.933424 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5efc21e0-dd81-47f3-be27-fc99856f4f47 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7/os-volume_attachments/8ef78338-2990-4ff8-bdb5-ee08d96c0e49" status: 202 len: 0 microversion: 2.1 time: 0.247918 Aug 26 11:15:08.933858 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 503/981] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 11:15:08 2022] DELETE /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7/os-volume_attachments/8ef78338-2990-4ff8-bdb5-ee08d96c0e49 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:15:08.944079 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-bb9e04b9-71aa-48c5-90c4-74bbf0e0e43d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:08.946868 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-bb9e04b9-71aa-48c5-90c4-74bbf0e0e43d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:08.958711 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb9e04b9-71aa-48c5-90c4-74bbf0e0e43d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:08.959434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb9e04b9-71aa-48c5-90c4-74bbf0e0e43d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:08.960344 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb9e04b9-71aa-48c5-90c4-74bbf0e0e43d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:08.961743 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb9e04b9-71aa-48c5-90c4-74bbf0e0e43d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:08.962502 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb9e04b9-71aa-48c5-90c4-74bbf0e0e43d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:08.962940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb9e04b9-71aa-48c5-90c4-74bbf0e0e43d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:09.001722 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-bb9e04b9-71aa-48c5-90c4-74bbf0e0e43d tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062883 Aug 26 11:15:09.002682 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 479/982] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:15:08 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:15:10.012513 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=4 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:15:10.016938 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-807da90d-f0ad-4bf7-8443-94184c67de2f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:10.019516 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-807da90d-f0ad-4bf7-8443-94184c67de2f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:10.027704 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-807da90d-f0ad-4bf7-8443-94184c67de2f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:10.027704 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-807da90d-f0ad-4bf7-8443-94184c67de2f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:10.028050 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-807da90d-f0ad-4bf7-8443-94184c67de2f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:10.028732 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-807da90d-f0ad-4bf7-8443-94184c67de2f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:10.029184 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-807da90d-f0ad-4bf7-8443-94184c67de2f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:10.029608 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-807da90d-f0ad-4bf7-8443-94184c67de2f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:10.062896 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-807da90d-f0ad-4bf7-8443-94184c67de2f tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051739 Aug 26 11:15:10.063488 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 504/983] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 11:15:10 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 11:15:10.239966 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b1d3062e-d8dd-49f7-ba48-8ddc856c9819 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:10.240597 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b1d3062e-d8dd-49f7-ba48-8ddc856c9819 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:10.248607 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1d3062e-d8dd-49f7-ba48-8ddc856c9819 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:10.250709 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1d3062e-d8dd-49f7-ba48-8ddc856c9819 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:10.250709 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1d3062e-d8dd-49f7-ba48-8ddc856c9819 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:10.250709 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1d3062e-d8dd-49f7-ba48-8ddc856c9819 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:10.251026 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1d3062e-d8dd-49f7-ba48-8ddc856c9819 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:10.251437 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1d3062e-d8dd-49f7-ba48-8ddc856c9819 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:10.286761 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b1d3062e-d8dd-49f7-ba48-8ddc856c9819 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:15:10.379231 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b1d3062e-d8dd-49f7-ba48-8ddc856c9819 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 204 len: 0 microversion: 2.1 time: 0.144619 Aug 26 11:15:10.380606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 480/984] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:15:10 2022] DELETE /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:15:10.388777 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-55e1db47-754d-4219-a9f8-ede18a4e2d42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:10.389383 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-55e1db47-754d-4219-a9f8-ede18a4e2d42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:10.396361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-55e1db47-754d-4219-a9f8-ede18a4e2d42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:10.396824 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-55e1db47-754d-4219-a9f8-ede18a4e2d42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:10.397243 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-55e1db47-754d-4219-a9f8-ede18a4e2d42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:10.397960 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-55e1db47-754d-4219-a9f8-ede18a4e2d42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:10.398437 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-55e1db47-754d-4219-a9f8-ede18a4e2d42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:10.398854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-55e1db47-754d-4219-a9f8-ede18a4e2d42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:10.545912 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-55e1db47-754d-4219-a9f8-ede18a4e2d42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:10.554904 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-55e1db47-754d-4219-a9f8-ede18a4e2d42 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 200 len: 1679 microversion: 2.1 time: 0.169935 Aug 26 11:15:10.555495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 505/985] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:10 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:11.578338 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-333119cb-4043-439e-97a9-2e668a3dcd6a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:11.578950 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-333119cb-4043-439e-97a9-2e668a3dcd6a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:11.586506 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-333119cb-4043-439e-97a9-2e668a3dcd6a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:11.586989 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-333119cb-4043-439e-97a9-2e668a3dcd6a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:11.587425 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-333119cb-4043-439e-97a9-2e668a3dcd6a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:11.588127 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-333119cb-4043-439e-97a9-2e668a3dcd6a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:11.588572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-333119cb-4043-439e-97a9-2e668a3dcd6a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:11.588994 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-333119cb-4043-439e-97a9-2e668a3dcd6a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:11.736118 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-333119cb-4043-439e-97a9-2e668a3dcd6a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:11.745132 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-333119cb-4043-439e-97a9-2e668a3dcd6a tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 200 len: 1679 microversion: 2.1 time: 0.171223 Aug 26 11:15:11.745709 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 481/986] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:11 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:12.767128 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-e219f266-582f-4a34-ba1e-ba1f11720f63 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:12.767971 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e219f266-582f-4a34-ba1e-ba1f11720f63 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:12.774875 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e219f266-582f-4a34-ba1e-ba1f11720f63 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:12.775367 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e219f266-582f-4a34-ba1e-ba1f11720f63 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:12.775802 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e219f266-582f-4a34-ba1e-ba1f11720f63 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:12.776501 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e219f266-582f-4a34-ba1e-ba1f11720f63 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:12.776953 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e219f266-582f-4a34-ba1e-ba1f11720f63 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:12.777374 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e219f266-582f-4a34-ba1e-ba1f11720f63 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:12.849322 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-e219f266-582f-4a34-ba1e-ba1f11720f63 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85716f53e88048af9a8fdcbe4415979c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f780402b93f94d26b2fceab83c0bf485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:12.858246 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-e219f266-582f-4a34-ba1e-ba1f11720f63 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 200 len: 1612 microversion: 2.1 time: 0.095022 Aug 26 11:15:12.862766 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 506/987] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:12 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 1612 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:15:13.140896 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-51dda9e2-f969-4fd7-92a3-d1a00da78417 req-5bdb3ff4-a2a4-430d-a517-e52a2bb214ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b10c0f-0618-466b-834f-1041854727f7", "name": "network-vif-deleted", "tag": "49da4d2c-f694-4df3-9b1c-3b441f4f950e"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:15:13.152475 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-51dda9e2-f969-4fd7-92a3-d1a00da78417 req-5bdb3ff4-a2a4-430d-a517-e52a2bb214ca service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:13.153269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-51dda9e2-f969-4fd7-92a3-d1a00da78417 req-5bdb3ff4-a2a4-430d-a517-e52a2bb214ca service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:13.153938 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-51dda9e2-f969-4fd7-92a3-d1a00da78417 req-5bdb3ff4-a2a4-430d-a517-e52a2bb214ca service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:13.167527 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-51dda9e2-f969-4fd7-92a3-d1a00da78417 req-5bdb3ff4-a2a4-430d-a517-e52a2bb214ca service nova] Creating event network-vif-deleted:49da4d2c-f694-4df3-9b1c-3b441f4f950e for instance d9b10c0f-0618-466b-834f-1041854727f7 on hv-cinder-85236 Aug 26 11:15:13.174365 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-51dda9e2-f969-4fd7-92a3-d1a00da78417 req-5bdb3ff4-a2a4-430d-a517-e52a2bb214ca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036766 Aug 26 11:15:13.176151 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 482/988] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:15:13.881808 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-719a2027-a5e7-4ccc-9fa5-73f49a7f3e52 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:13.882452 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-719a2027-a5e7-4ccc-9fa5-73f49a7f3e52 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:13.888914 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-719a2027-a5e7-4ccc-9fa5-73f49a7f3e52 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:13.889406 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-719a2027-a5e7-4ccc-9fa5-73f49a7f3e52 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:13.889839 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-719a2027-a5e7-4ccc-9fa5-73f49a7f3e52 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:13.890575 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-719a2027-a5e7-4ccc-9fa5-73f49a7f3e52 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:13.891032 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-719a2027-a5e7-4ccc-9fa5-73f49a7f3e52 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:13.891487 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-719a2027-a5e7-4ccc-9fa5-73f49a7f3e52 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:13.906256 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-719a2027-a5e7-4ccc-9fa5-73f49a7f3e52 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] HTTP exception thrown: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-719a2027-a5e7-4ccc-9fa5-73f49a7f3e52 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Request method failure captured: Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 HTTP/1.1 Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKoS760bbZGFLZIOtz0bKN10taydUPpuaCKVzX6gMaWx7hZAZTvcJMm_yZoNCB5lp_e9MQjhaY7MeAuvI46fhuwxrStFhmWy1UiPbfomblZkYtULFDPdpOJqpKIXIq_HGXEQgCHtVLesHEPgZPUJF6lSZ6rQfXeWj1bDY2Cb8a6cLCs Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:15:13.908037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:15:13.911007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}] Aug 26 11:15:13.911007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:13.911007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:13.911007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:13.911007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:13.911007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:15:13.911007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:15:13.911007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: 85716f53e88048af9a8fdcbe4415979c Aug 26 11:15:13.911007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:13.911007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:15:13.911007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. Aug 26 11:15:13.911007 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': 'd9b10c0f-0618-466b-834f-1041854727f7'} Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:15:13.911992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. Aug 26 11:15:13.913559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:15:13.916031 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-719a2027-a5e7-4ccc-9fa5-73f49a7f3e52 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Returning 404 to user: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:15:13.916031 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-719a2027-a5e7-4ccc-9fa5-73f49a7f3e52 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 404 len: 111 microversion: 2.1 time: 0.032000 Aug 26 11:15:13.916031 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 507/989] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:13 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:15:13.920735 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-29928eb7-db93-4a86-a5fe-f3de68b33410 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '.version_select at 0x7f1a6884f550>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:13.942052 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-29928eb7-db93-4a86-a5fe-f3de68b33410 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1936257624" status: 202 len: 0 microversion: 2.1 time: 0.025710 Aug 26 11:15:13.942690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 483/990] 10.222.0.40 () {58 vars in 1221 bytes} [Fri Aug 26 11:15:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1936257624 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:15:15.764163 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3e31e1bf-6331-42cf-becf-d5a58a25c79b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:15.764752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-3e31e1bf-6331-42cf-becf-d5a58a25c79b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:15.772332 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3e31e1bf-6331-42cf-becf-d5a58a25c79b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:15.772821 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3e31e1bf-6331-42cf-becf-d5a58a25c79b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:15.773256 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3e31e1bf-6331-42cf-becf-d5a58a25c79b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:15.773963 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3e31e1bf-6331-42cf-becf-d5a58a25c79b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:15.774443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3e31e1bf-6331-42cf-becf-d5a58a25c79b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:15.774863 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3e31e1bf-6331-42cf-becf-d5a58a25c79b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:15.789562 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-3e31e1bf-6331-42cf-becf-d5a58a25c79b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] HTTP exception thrown: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3e31e1bf-6331-42cf-becf-d5a58a25c79b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Request method failure captured: Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: DELETE /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 HTTP/1.1 Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKoS760bbZGFLZIOtz0bKN10taydUPpuaCKVzX6gMaWx7hZAZTvcJMm_yZoNCB5lp_e9MQjhaY7MeAuvI46fhuwxrStFhmWy1UiPbfomblZkYtULFDPdpOJqpKIXIq_HGXEQgCHtVLesHEPgZPUJF6lSZ6rQfXeWj1bDY2Cb8a6cLCs Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:15:15.791101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:15:15.792903 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}] Aug 26 11:15:15.792903 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:15.792903 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:15.792903 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:15.792903 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:15.792903 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:15:15.792903 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:15:15.792903 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: 85716f53e88048af9a8fdcbe4415979c Aug 26 11:15:15.792903 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:15.792903 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:15:15.792903 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. Aug 26 11:15:15.792903 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': 'd9b10c0f-0618-466b-834f-1041854727f7'} Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:15:15.793854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. Aug 26 11:15:15.795362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:15:15.796862 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3e31e1bf-6331-42cf-becf-d5a58a25c79b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Returning 404 to user: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:15:15.796862 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-3e31e1bf-6331-42cf-becf-d5a58a25c79b tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 404 len: 111 microversion: 2.1 time: 0.032243 Aug 26 11:15:15.796862 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 508/991] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:15:15 2022] DELETE /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:15:15.802018 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a462978a-5502-4449-b4f3-9508894f5aa2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:15.802847 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a462978a-5502-4449-b4f3-9508894f5aa2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: d9b10c0f-0618-466b-834f-1041854727f7] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:15.809582 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a462978a-5502-4449-b4f3-9508894f5aa2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:15.810131 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a462978a-5502-4449-b4f3-9508894f5aa2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:15.810574 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a462978a-5502-4449-b4f3-9508894f5aa2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:15.811277 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a462978a-5502-4449-b4f3-9508894f5aa2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:15.811727 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a462978a-5502-4449-b4f3-9508894f5aa2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:15.812160 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a462978a-5502-4449-b4f3-9508894f5aa2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:15.834153 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-a462978a-5502-4449-b4f3-9508894f5aa2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] HTTP exception thrown: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a462978a-5502-4449-b4f3-9508894f5aa2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Request method failure captured: Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 HTTP/1.1 Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKoS760bbZGFLZIOtz0bKN10taydUPpuaCKVzX6gMaWx7hZAZTvcJMm_yZoNCB5lp_e9MQjhaY7MeAuvI46fhuwxrStFhmWy1UiPbfomblZkYtULFDPdpOJqpKIXIq_HGXEQgCHtVLesHEPgZPUJF6lSZ6rQfXeWj1bDY2Cb8a6cLCs Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:15:15.835899 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:15:15.837576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}] Aug 26 11:15:15.837576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:15.837576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:15.837576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:15.837576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:15.837576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:15:15.837576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:15:15.837576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 85716f53e88048af9a8fdcbe4415979c Aug 26 11:15:15.837576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:15.837576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:15:15.837576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. Aug 26 11:15:15.837576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'd9b10c0f-0618-466b-834f-1041854727f7'} Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:15:15.838606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. Aug 26 11:15:15.840303 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:15.841777 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a462978a-5502-4449-b4f3-9508894f5aa2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Returning 404 to user: Instance d9b10c0f-0618-466b-834f-1041854727f7 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:15:15.841777 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a462978a-5502-4449-b4f3-9508894f5aa2 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7" status: 404 len: 111 microversion: 2.1 time: 0.039781 Aug 26 11:15:15.841777 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 484/992] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:15 2022] GET /compute/v2.1/servers/d9b10c0f-0618-466b-834f-1041854727f7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 11:15:16.375956 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1250819345", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-373540222", "security_groups": [{"name": "tempest-secgroup-smoke-1782751179"}], "networks": [{"uuid": "05df7768-c059-43ef-a381-82d5cc20db95"}], "block_device_mapping_v2": [{"uuid": "108150b3-8211-4044-a9b5-494378602098", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:15:16.495852 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.network.neutron [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] validate_networks() for [('05df7768-c059-43ef-a381-82d5cc20db95', None, None, None, None, None)] {{(pid=120605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:15:16.915614 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Flavor limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:15:16.916217 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Image limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:15:16.916499 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Flavor pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:15:16.916941 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Image pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:15:16.917351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:15:16.926339 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:16.926819 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:16.927313 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:16.928044 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:16.928496 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:16.928921 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:16.946251 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Getting quotas for project 3d84157876f945099fda5fcb9d3f6c20. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:15:16.950201 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Getting quotas for user 93bec07110aa4697ab59ced454a51f9a and project 3d84157876f945099fda5fcb9d3f6c20. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:15:17.002888 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1fc2f40f-f449-43bd-811d-70335e9d2b97 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:17.003418 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1fc2f40f-f449-43bd-811d-70335e9d2b97 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:17.010169 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1fc2f40f-f449-43bd-811d-70335e9d2b97 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:17.010712 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1fc2f40f-f449-43bd-811d-70335e9d2b97 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:17.011145 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1fc2f40f-f449-43bd-811d-70335e9d2b97 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:17.011305 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Going to run 1 instances... {{(pid=120605) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:15:17.011843 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1fc2f40f-f449-43bd-811d-70335e9d2b97 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:17.012289 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1fc2f40f-f449-43bd-811d-70335e9d2b97 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:17.012701 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1fc2f40f-f449-43bd-811d-70335e9d2b97 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:17.013448 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='108150b3-8211-4044-a9b5-494378602098',volume_size=None,volume_type=None)] {{(pid=120605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:15:17.027458 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-1fc2f40f-f449-43bd-811d-70335e9d2b97 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] HTTP exception thrown: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1fc2f40f-f449-43bd-811d-70335e9d2b97 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Request method failure captured: Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: DELETE /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 HTTP/1.1 Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKoS760bbZGFLZIOtz0bKN10taydUPpuaCKVzX6gMaWx7hZAZTvcJMm_yZoNCB5lp_e9MQjhaY7MeAuvI46fhuwxrStFhmWy1UiPbfomblZkYtULFDPdpOJqpKIXIq_HGXEQgCHtVLesHEPgZPUJF6lSZ6rQfXeWj1bDY2Cb8a6cLCs Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:15:17.029147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:15:17.030889 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}] Aug 26 11:15:17.030889 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:17.030889 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:17.030889 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:17.030889 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:17.030889 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:15:17.030889 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:15:17.030889 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 85716f53e88048af9a8fdcbe4415979c Aug 26 11:15:17.030889 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:17.030889 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:15:17.030889 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. Aug 26 11:15:17.030889 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'c0e78763-5fe6-49aa-9aaa-f609e352fe01'} Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:15:17.031904 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. Aug 26 11:15:17.033415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.035598 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1fc2f40f-f449-43bd-811d-70335e9d2b97 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Returning 404 to user: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:15:17.035598 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1fc2f40f-f449-43bd-811d-70335e9d2b97 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 404 len: 111 microversion: 2.1 time: 0.031962 Aug 26 11:15:17.035598 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 485/993] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:15:16 2022] DELETE /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 11:15:17.040568 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6a5a5cbe-08bb-40f1-9f9f-b8ad96b4fe41 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:17.041181 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6a5a5cbe-08bb-40f1-9f9f-b8ad96b4fe41 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: c0e78763-5fe6-49aa-9aaa-f609e352fe01] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:17.047315 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a5a5cbe-08bb-40f1-9f9f-b8ad96b4fe41 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:17.047786 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a5a5cbe-08bb-40f1-9f9f-b8ad96b4fe41 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:17.048363 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a5a5cbe-08bb-40f1-9f9f-b8ad96b4fe41 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:17.048977 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a5a5cbe-08bb-40f1-9f9f-b8ad96b4fe41 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:17.049453 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a5a5cbe-08bb-40f1-9f9f-b8ad96b4fe41 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:17.050063 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a5a5cbe-08bb-40f1-9f9f-b8ad96b4fe41 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:17.064150 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-6a5a5cbe-08bb-40f1-9f9f-b8ad96b4fe41 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] HTTP exception thrown: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6a5a5cbe-08bb-40f1-9f9f-b8ad96b4fe41 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Request method failure captured: Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 HTTP/1.1 Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKoS760bbZGFLZIOtz0bKN10taydUPpuaCKVzX6gMaWx7hZAZTvcJMm_yZoNCB5lp_e9MQjhaY7MeAuvI46fhuwxrStFhmWy1UiPbfomblZkYtULFDPdpOJqpKIXIq_HGXEQgCHtVLesHEPgZPUJF6lSZ6rQfXeWj1bDY2Cb8a6cLCs Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:15:17.066057 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:15:17.067949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}] Aug 26 11:15:17.067949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:17.067949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:17.067949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:17.067949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:17.067949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:15:17.067949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:15:17.067949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 85716f53e88048af9a8fdcbe4415979c Aug 26 11:15:17.067949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:17.067949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:15:17.067949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. Aug 26 11:15:17.067949 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'c0e78763-5fe6-49aa-9aaa-f609e352fe01'} Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:15:17.068726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. Aug 26 11:15:17.070121 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.071279 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6a5a5cbe-08bb-40f1-9f9f-b8ad96b4fe41 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Returning 404 to user: Instance c0e78763-5fe6-49aa-9aaa-f609e352fe01 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:15:17.071279 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6a5a5cbe-08bb-40f1-9f9f-b8ad96b4fe41 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01" status: 404 len: 111 microversion: 2.1 time: 0.030746 Aug 26 11:15:17.071279 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 486/994] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:17 2022] GET /compute/v2.1/servers/c0e78763-5fe6-49aa-9aaa-f609e352fe01 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:15:17.076782 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7bb3ce85-7f85-49f4-85e9-e828dbde62d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:17.077283 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7bb3ce85-7f85-49f4-85e9-e828dbde62d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:17.085555 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7bb3ce85-7f85-49f4-85e9-e828dbde62d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:17.086605 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7bb3ce85-7f85-49f4-85e9-e828dbde62d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:17.087292 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7bb3ce85-7f85-49f4-85e9-e828dbde62d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:17.088420 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7bb3ce85-7f85-49f4-85e9-e828dbde62d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:17.089145 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7bb3ce85-7f85-49f4-85e9-e828dbde62d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:17.089864 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7bb3ce85-7f85-49f4-85e9-e828dbde62d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:17.107891 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-7bb3ce85-7f85-49f4-85e9-e828dbde62d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] HTTP exception thrown: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7bb3ce85-7f85-49f4-85e9-e828dbde62d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Request method failure captured: Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: DELETE /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 HTTP/1.1 Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKoS760bbZGFLZIOtz0bKN10taydUPpuaCKVzX6gMaWx7hZAZTvcJMm_yZoNCB5lp_e9MQjhaY7MeAuvI46fhuwxrStFhmWy1UiPbfomblZkYtULFDPdpOJqpKIXIq_HGXEQgCHtVLesHEPgZPUJF6lSZ6rQfXeWj1bDY2Cb8a6cLCs Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:15:17.109630 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:15:17.111014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}] Aug 26 11:15:17.111014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:17.111014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:17.111014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:17.111014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:17.111014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:15:17.111014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:15:17.111014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 85716f53e88048af9a8fdcbe4415979c Aug 26 11:15:17.111014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:17.111014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:15:17.111014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. Aug 26 11:15:17.111014 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'f84ff179-7a07-42bc-9fe4-689622b81ef1'} Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:15:17.111784 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. Aug 26 11:15:17.113207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.115861 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7bb3ce85-7f85-49f4-85e9-e828dbde62d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Returning 404 to user: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:15:17.115861 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7bb3ce85-7f85-49f4-85e9-e828dbde62d0 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 404 len: 111 microversion: 2.1 time: 0.038346 Aug 26 11:15:17.115861 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 487/995] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:15:17 2022] DELETE /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:15:17.119589 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8e580b25-f911-4f4e-81ff-15be577d7f37 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:17.120205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8e580b25-f911-4f4e-81ff-15be577d7f37 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: f84ff179-7a07-42bc-9fe4-689622b81ef1] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:17.126642 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8e580b25-f911-4f4e-81ff-15be577d7f37 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:17.127125 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8e580b25-f911-4f4e-81ff-15be577d7f37 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:17.127559 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8e580b25-f911-4f4e-81ff-15be577d7f37 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:17.128348 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8e580b25-f911-4f4e-81ff-15be577d7f37 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:17.128843 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8e580b25-f911-4f4e-81ff-15be577d7f37 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:17.129140 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8e580b25-f911-4f4e-81ff-15be577d7f37 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:17.144290 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-8e580b25-f911-4f4e-81ff-15be577d7f37 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] HTTP exception thrown: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8e580b25-f911-4f4e-81ff-15be577d7f37 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Request method failure captured: Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 HTTP/1.1 Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKoS760bbZGFLZIOtz0bKN10taydUPpuaCKVzX6gMaWx7hZAZTvcJMm_yZoNCB5lp_e9MQjhaY7MeAuvI46fhuwxrStFhmWy1UiPbfomblZkYtULFDPdpOJqpKIXIq_HGXEQgCHtVLesHEPgZPUJF6lSZ6rQfXeWj1bDY2Cb8a6cLCs Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:15:17.145812 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:15:17.147503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}] Aug 26 11:15:17.147503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:17.147503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:17.147503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:17.147503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:17.147503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:15:17.147503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:15:17.147503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 85716f53e88048af9a8fdcbe4415979c Aug 26 11:15:17.147503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:17.147503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:15:17.147503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. Aug 26 11:15:17.147503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'f84ff179-7a07-42bc-9fe4-689622b81ef1'} Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:15:17.148347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. Aug 26 11:15:17.150187 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:17.152820 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8e580b25-f911-4f4e-81ff-15be577d7f37 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Returning 404 to user: Instance f84ff179-7a07-42bc-9fe4-689622b81ef1 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:15:17.152820 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8e580b25-f911-4f4e-81ff-15be577d7f37 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1" status: 404 len: 111 microversion: 2.1 time: 0.031344 Aug 26 11:15:17.152820 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 488/996] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:17 2022] GET /compute/v2.1/servers/f84ff179-7a07-42bc-9fe4-689622b81ef1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 11:15:17.158802 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-bab6d0e8-0433-4f07-94f2-6143b9aef594 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.787521 Aug 26 11:15:17.160295 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 509/997] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:15:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:15:17.171183 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-771854cb-0e14-43d2-924d-e15db1d8d619 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:17.171936 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-771854cb-0e14-43d2-924d-e15db1d8d619 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:17.238347 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-771854cb-0e14-43d2-924d-e15db1d8d619 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:17.246658 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-771854cb-0e14-43d2-924d-e15db1d8d619 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1088 microversion: 2.1 time: 0.078532 Aug 26 11:15:17.246658 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 489/998] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:17 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1088 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:15:18.268207 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-004c3b7c-8ef4-40b2-906e-a6d5c1d919f8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:18.269371 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-004c3b7c-8ef4-40b2-906e-a6d5c1d919f8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:18.275680 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-004c3b7c-8ef4-40b2-906e-a6d5c1d919f8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:18.276162 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-004c3b7c-8ef4-40b2-906e-a6d5c1d919f8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:18.276590 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-004c3b7c-8ef4-40b2-906e-a6d5c1d919f8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:18.277278 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-004c3b7c-8ef4-40b2-906e-a6d5c1d919f8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:18.277726 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-004c3b7c-8ef4-40b2-906e-a6d5c1d919f8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:18.278186 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-004c3b7c-8ef4-40b2-906e-a6d5c1d919f8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:18.343650 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-004c3b7c-8ef4-40b2-906e-a6d5c1d919f8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:18.351697 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-004c3b7c-8ef4-40b2-906e-a6d5c1d919f8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1138 microversion: 2.1 time: 0.087972 Aug 26 11:15:18.352286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 510/999] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:18 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1138 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:19.373005 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2dff98f9-7851-4779-9da1-46b7cfce4035 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:19.373682 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2dff98f9-7851-4779-9da1-46b7cfce4035 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:19.382137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2dff98f9-7851-4779-9da1-46b7cfce4035 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:19.382636 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2dff98f9-7851-4779-9da1-46b7cfce4035 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:19.383101 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2dff98f9-7851-4779-9da1-46b7cfce4035 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:19.383793 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2dff98f9-7851-4779-9da1-46b7cfce4035 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:19.384245 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2dff98f9-7851-4779-9da1-46b7cfce4035 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:19.384672 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2dff98f9-7851-4779-9da1-46b7cfce4035 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:19.452222 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2dff98f9-7851-4779-9da1-46b7cfce4035 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:19.460767 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2dff98f9-7851-4779-9da1-46b7cfce4035 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1138 microversion: 2.1 time: 0.091851 Aug 26 11:15:19.461332 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 490/1000] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:19 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1138 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:20.438937 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a2a6b87b-4caf-44f3-a9cc-37a0e56dce15 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:20.439583 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-a2a6b87b-4caf-44f3-a9cc-37a0e56dce15 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:20.446171 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a2a6b87b-4caf-44f3-a9cc-37a0e56dce15 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:20.446665 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a2a6b87b-4caf-44f3-a9cc-37a0e56dce15 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:20.447107 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a2a6b87b-4caf-44f3-a9cc-37a0e56dce15 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:20.447828 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a2a6b87b-4caf-44f3-a9cc-37a0e56dce15 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:20.448284 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a2a6b87b-4caf-44f3-a9cc-37a0e56dce15 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:20.448728 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a2a6b87b-4caf-44f3-a9cc-37a0e56dce15 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:20.462852 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-a2a6b87b-4caf-44f3-a9cc-37a0e56dce15 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] HTTP exception thrown: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a2a6b87b-4caf-44f3-a9cc-37a0e56dce15 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Request method failure captured: Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: DELETE /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 HTTP/1.1 Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKoS760bbZGFLZIOtz0bKN10taydUPpuaCKVzX6gMaWx7hZAZTvcJMm_yZoNCB5lp_e9MQjhaY7MeAuvI46fhuwxrStFhmWy1UiPbfomblZkYtULFDPdpOJqpKIXIq_HGXEQgCHtVLesHEPgZPUJF6lSZ6rQfXeWj1bDY2Cb8a6cLCs Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:15:20.464483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:15:20.466155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}] Aug 26 11:15:20.466155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:20.466155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:20.466155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:20.466155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:20.466155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:15:20.466155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:15:20.466155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: 85716f53e88048af9a8fdcbe4415979c Aug 26 11:15:20.466155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:20.466155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:15:20.466155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. Aug 26 11:15:20.466155 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': 'b1845fcd-057b-4fc1-8761-a09197883c62'} Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:15:20.467106 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. Aug 26 11:15:20.468418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:15:20.470036 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a2a6b87b-4caf-44f3-a9cc-37a0e56dce15 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Returning 404 to user: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:15:20.470036 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-a2a6b87b-4caf-44f3-a9cc-37a0e56dce15 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 404 len: 111 microversion: 2.1 time: 0.030939 Aug 26 11:15:20.470036 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 511/1001] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:15:20 2022] DELETE /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:15:20.475878 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1427d4e5-4c7b-4d2e-9406-3269a3685f55 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:20.476513 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1427d4e5-4c7b-4d2e-9406-3269a3685f55 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] [instance: b1845fcd-057b-4fc1-8761-a09197883c62] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:20.481153 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-aab9466d-7d7d-4144-9798-775fdfa6a9ba tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:20.481861 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-aab9466d-7d7d-4144-9798-775fdfa6a9ba tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:20.483943 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1427d4e5-4c7b-4d2e-9406-3269a3685f55 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:20.484442 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1427d4e5-4c7b-4d2e-9406-3269a3685f55 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:20.484970 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1427d4e5-4c7b-4d2e-9406-3269a3685f55 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:20.485653 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1427d4e5-4c7b-4d2e-9406-3269a3685f55 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:20.486236 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1427d4e5-4c7b-4d2e-9406-3269a3685f55 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:20.486689 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1427d4e5-4c7b-4d2e-9406-3269a3685f55 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:20.489792 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aab9466d-7d7d-4144-9798-775fdfa6a9ba tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:20.490418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aab9466d-7d7d-4144-9798-775fdfa6a9ba tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:20.490780 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aab9466d-7d7d-4144-9798-775fdfa6a9ba tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:20.491481 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aab9466d-7d7d-4144-9798-775fdfa6a9ba tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:20.491935 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aab9466d-7d7d-4144-9798-775fdfa6a9ba tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:20.492357 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aab9466d-7d7d-4144-9798-775fdfa6a9ba tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:20.502387 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-1427d4e5-4c7b-4d2e-9406-3269a3685f55 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] HTTP exception thrown: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1427d4e5-4c7b-4d2e-9406-3269a3685f55 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Request method failure captured: Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 HTTP/1.1 Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKoS760bbZGFLZIOtz0bKN10taydUPpuaCKVzX6gMaWx7hZAZTvcJMm_yZoNCB5lp_e9MQjhaY7MeAuvI46fhuwxrStFhmWy1UiPbfomblZkYtULFDPdpOJqpKIXIq_HGXEQgCHtVLesHEPgZPUJF6lSZ6rQfXeWj1bDY2Cb8a6cLCs Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:15:20.504521 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:15:20.506238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f780402b93f94d26b2fceab83c0bf485"}]}] Aug 26 11:15:20.506238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:20.506238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: f780402b93f94d26b2fceab83c0bf485 Aug 26 11:15:20.506238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-755014839 Aug 26 11:15:20.506238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:20.506238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:15:20.506238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:15:20.506238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 85716f53e88048af9a8fdcbe4415979c Aug 26 11:15:20.506238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeNegativeTest-755014839-project Aug 26 11:15:20.506238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:15:20.506238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. Aug 26 11:15:20.506238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'b1845fcd-057b-4fc1-8761-a09197883c62'} Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:15:20.507137 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. Aug 26 11:15:20.508663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:15:20.510646 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1427d4e5-4c7b-4d2e-9406-3269a3685f55 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] Returning 404 to user: Instance b1845fcd-057b-4fc1-8761-a09197883c62 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:15:20.511690 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1427d4e5-4c7b-4d2e-9406-3269a3685f55 tempest-AttachVolumeNegativeTest-755014839 tempest-AttachVolumeNegativeTest-755014839-project] 10.222.0.40 "GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62" status: 404 len: 111 microversion: 2.1 time: 0.040557 Aug 26 11:15:20.512777 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 491/1002] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:20 2022] GET /compute/v2.1/servers/b1845fcd-057b-4fc1-8761-a09197883c62 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:15:20.574949 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-aab9466d-7d7d-4144-9798-775fdfa6a9ba tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:20.586326 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-aab9466d-7d7d-4144-9798-775fdfa6a9ba tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1204 microversion: 2.1 time: 0.109234 Aug 26 11:15:20.587233 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 512/1003] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:20 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1204 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:15:21.619028 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-dce64944-3ab4-4cfc-a98a-d124cbc710e3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:21.619576 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-dce64944-3ab4-4cfc-a98a-d124cbc710e3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:21.626604 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dce64944-3ab4-4cfc-a98a-d124cbc710e3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:21.627385 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dce64944-3ab4-4cfc-a98a-d124cbc710e3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:21.627826 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dce64944-3ab4-4cfc-a98a-d124cbc710e3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:21.628559 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dce64944-3ab4-4cfc-a98a-d124cbc710e3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:21.629006 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dce64944-3ab4-4cfc-a98a-d124cbc710e3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:21.629426 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dce64944-3ab4-4cfc-a98a-d124cbc710e3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:21.825656 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-64537df5-58db-4bca-a673-a37aa5f786da req-fabf9c3a-77ff-44da-ad2c-bcf7565ca20d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ca2d22c-594f-47aa-9933-e2679fa45d7f", "tag": "f1a9a75b-57a5-451f-a187-16c7dd13630c"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:15:21.845939 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-64537df5-58db-4bca-a673-a37aa5f786da req-fabf9c3a-77ff-44da-ad2c-bcf7565ca20d service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:21.847900 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-64537df5-58db-4bca-a673-a37aa5f786da req-fabf9c3a-77ff-44da-ad2c-bcf7565ca20d service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:21.848664 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-64537df5-58db-4bca-a673-a37aa5f786da req-fabf9c3a-77ff-44da-ad2c-bcf7565ca20d service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:21.864153 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-64537df5-58db-4bca-a673-a37aa5f786da req-fabf9c3a-77ff-44da-ad2c-bcf7565ca20d service nova] Creating event network-changed:f1a9a75b-57a5-451f-a187-16c7dd13630c for instance 9ca2d22c-594f-47aa-9933-e2679fa45d7f on hv-cinder-85236 Aug 26 11:15:21.872209 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-64537df5-58db-4bca-a673-a37aa5f786da req-fabf9c3a-77ff-44da-ad2c-bcf7565ca20d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062279 Aug 26 11:15:21.873468 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 513/1004] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:15:21.912171 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-dce64944-3ab4-4cfc-a98a-d124cbc710e3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:21.928459 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-dce64944-3ab4-4cfc-a98a-d124cbc710e3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1260 microversion: 2.1 time: 0.313046 Aug 26 11:15:21.930717 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 492/1005] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:21 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1260 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:22.951696 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-6284db0b-d43b-4e90-8983-8ce140956faa tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:22.953216 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-6284db0b-d43b-4e90-8983-8ce140956faa tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:22.962974 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6284db0b-d43b-4e90-8983-8ce140956faa tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:22.963643 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6284db0b-d43b-4e90-8983-8ce140956faa tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:22.964088 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6284db0b-d43b-4e90-8983-8ce140956faa tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:22.965514 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6284db0b-d43b-4e90-8983-8ce140956faa tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:22.966211 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6284db0b-d43b-4e90-8983-8ce140956faa tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:22.966648 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6284db0b-d43b-4e90-8983-8ce140956faa tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:23.114847 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6284db0b-d43b-4e90-8983-8ce140956faa tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:23.123598 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-6284db0b-d43b-4e90-8983-8ce140956faa tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1260 microversion: 2.1 time: 0.176096 Aug 26 11:15:23.136339 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 514/1006] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:22 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:24.147010 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0c8d99f2-5c56-4378-8f4e-d3610ad56e05 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:24.147851 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0c8d99f2-5c56-4378-8f4e-d3610ad56e05 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:24.154572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c8d99f2-5c56-4378-8f4e-d3610ad56e05 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:24.155053 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c8d99f2-5c56-4378-8f4e-d3610ad56e05 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:24.155490 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c8d99f2-5c56-4378-8f4e-d3610ad56e05 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:24.156194 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c8d99f2-5c56-4378-8f4e-d3610ad56e05 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:24.156643 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c8d99f2-5c56-4378-8f4e-d3610ad56e05 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:24.157064 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c8d99f2-5c56-4378-8f4e-d3610ad56e05 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:24.615254 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2044369576", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-246835179", "security_groups": [{"name": "tempest-secgroup-smoke-1665899742"}], "block_device_mapping_v2": [{"uuid": "a262a37d-2416-42ff-a51e-7ea38f381ad0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bdfdb3db-3bbb-431b-99cd-605e0811c994"}]}} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:15:24.621675 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0c8d99f2-5c56-4378-8f4e-d3610ad56e05 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:24.633477 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0c8d99f2-5c56-4378-8f4e-d3610ad56e05 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1260 microversion: 2.1 time: 0.491118 Aug 26 11:15:24.634898 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 493/1007] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:24 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1260 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:24.753011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.network.neutron [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] validate_networks() for [('bdfdb3db-3bbb-431b-99cd-605e0811c994', None, None, None, None, None)] {{(pid=120605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 11:15:25.238400 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Flavor limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 11:15:25.238937 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Image limits 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 11:15:25.239443 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Flavor pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 11:15:25.239869 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Image pref 0:0:0 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 11:15:25.240278 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.virt.hardware [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 11:15:25.254809 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:25.255301 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:25.255740 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:25.256499 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:25.256960 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:25.257388 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:25.275531 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Getting quotas for project d773f20240a44729b159c57c80e017ef. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 11:15:25.279819 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.quota [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Getting quotas for user 9e8355dc324e49d881b9f0fc5c2923ad and project d773f20240a44729b159c57c80e017ef. Resources: {'instances', 'ram', 'cores'} {{(pid=120605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 11:15:25.348753 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Going to run 1 instances... {{(pid=120605) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 11:15:25.350950 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a262a37d-2416-42ff-a51e-7ea38f381ad0',volume_size=None,volume_type=None)] {{(pid=120605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 11:15:25.498691 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-aab8d806-a0fe-4511-b5df-31cbd2845f27 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.888610 Aug 26 11:15:25.505338 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 515/1008] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 11:15:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 11:15:25.513064 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f81372d5-2ccb-4dc5-9870-c437d7c66691 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:25.514655 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f81372d5-2ccb-4dc5-9870-c437d7c66691 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:25.576649 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f81372d5-2ccb-4dc5-9870-c437d7c66691 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:25.584433 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f81372d5-2ccb-4dc5-9870-c437d7c66691 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1094 microversion: 2.1 time: 0.075899 Aug 26 11:15:25.586025 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 494/1009] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:25 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:25.670737 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-db840be7-c6da-4dda-85ea-919c8184f14b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:25.673787 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-db840be7-c6da-4dda-85ea-919c8184f14b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:25.680670 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db840be7-c6da-4dda-85ea-919c8184f14b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:25.681174 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db840be7-c6da-4dda-85ea-919c8184f14b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:25.681617 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db840be7-c6da-4dda-85ea-919c8184f14b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:25.682362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db840be7-c6da-4dda-85ea-919c8184f14b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:25.683023 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db840be7-c6da-4dda-85ea-919c8184f14b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:25.683710 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-db840be7-c6da-4dda-85ea-919c8184f14b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:25.934701 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-db840be7-c6da-4dda-85ea-919c8184f14b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:25.947092 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-db840be7-c6da-4dda-85ea-919c8184f14b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1260 microversion: 2.1 time: 0.281627 Aug 26 11:15:25.947787 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 516/1010] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:25 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1260 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:26.609951 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-31577fbf-7d8c-4036-8db8-2a5a51523e55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:26.610624 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-31577fbf-7d8c-4036-8db8-2a5a51523e55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:26.618106 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31577fbf-7d8c-4036-8db8-2a5a51523e55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:26.618608 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31577fbf-7d8c-4036-8db8-2a5a51523e55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:26.619049 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31577fbf-7d8c-4036-8db8-2a5a51523e55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:26.619764 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31577fbf-7d8c-4036-8db8-2a5a51523e55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:26.620430 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31577fbf-7d8c-4036-8db8-2a5a51523e55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:26.620750 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31577fbf-7d8c-4036-8db8-2a5a51523e55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:26.692550 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-31577fbf-7d8c-4036-8db8-2a5a51523e55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:26.700449 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-31577fbf-7d8c-4036-8db8-2a5a51523e55 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1192 microversion: 2.1 time: 0.094305 Aug 26 11:15:26.701046 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 495/1011] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:26 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:26.970066 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3d027e97-37f2-4fc3-b067-ad7d3d250ea4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:26.971285 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-3d027e97-37f2-4fc3-b067-ad7d3d250ea4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:26.980618 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3d027e97-37f2-4fc3-b067-ad7d3d250ea4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:26.982869 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3d027e97-37f2-4fc3-b067-ad7d3d250ea4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:26.983872 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3d027e97-37f2-4fc3-b067-ad7d3d250ea4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:26.984790 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3d027e97-37f2-4fc3-b067-ad7d3d250ea4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:26.985823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3d027e97-37f2-4fc3-b067-ad7d3d250ea4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:26.986300 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3d027e97-37f2-4fc3-b067-ad7d3d250ea4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:27.160838 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-3d027e97-37f2-4fc3-b067-ad7d3d250ea4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:27.168795 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-3d027e97-37f2-4fc3-b067-ad7d3d250ea4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1260 microversion: 2.1 time: 0.204365 Aug 26 11:15:27.169387 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 517/1012] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:26 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:27.723166 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9d814842-51e5-4510-ba25-92a750d1a2e4 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:27.723710 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9d814842-51e5-4510-ba25-92a750d1a2e4 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:27.732607 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d814842-51e5-4510-ba25-92a750d1a2e4 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:27.737341 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d814842-51e5-4510-ba25-92a750d1a2e4 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:27.737341 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d814842-51e5-4510-ba25-92a750d1a2e4 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:27.737341 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d814842-51e5-4510-ba25-92a750d1a2e4 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:27.737341 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d814842-51e5-4510-ba25-92a750d1a2e4 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:27.737748 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d814842-51e5-4510-ba25-92a750d1a2e4 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:27.898710 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9d814842-51e5-4510-ba25-92a750d1a2e4 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:27.908001 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9d814842-51e5-4510-ba25-92a750d1a2e4 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1266 microversion: 2.1 time: 0.190080 Aug 26 11:15:27.910046 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 496/1013] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:27 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:28.189627 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b8d9923c-1a92-4516-aba5-50a08ceb62b4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:28.190333 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b8d9923c-1a92-4516-aba5-50a08ceb62b4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:28.198411 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b8d9923c-1a92-4516-aba5-50a08ceb62b4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:28.198411 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b8d9923c-1a92-4516-aba5-50a08ceb62b4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:28.198411 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b8d9923c-1a92-4516-aba5-50a08ceb62b4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:28.199427 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b8d9923c-1a92-4516-aba5-50a08ceb62b4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:28.199427 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b8d9923c-1a92-4516-aba5-50a08ceb62b4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:28.199789 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b8d9923c-1a92-4516-aba5-50a08ceb62b4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:28.427327 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b8d9923c-1a92-4516-aba5-50a08ceb62b4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:28.437244 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b8d9923c-1a92-4516-aba5-50a08ceb62b4 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1260 microversion: 2.1 time: 0.251455 Aug 26 11:15:28.438535 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 518/1014] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:28 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:15:28.569610 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-665e44e4-645d-460e-a87e-5224981e766d req-b87262c9-1c1b-4757-a07f-a77c52837586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da518ab7-8778-41f2-b6e0-66740a427a16", "tag": "73ff051a-40d0-4991-a964-6aa8322f9de5"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:15:28.583822 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-665e44e4-645d-460e-a87e-5224981e766d req-b87262c9-1c1b-4757-a07f-a77c52837586 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:28.584395 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-665e44e4-645d-460e-a87e-5224981e766d req-b87262c9-1c1b-4757-a07f-a77c52837586 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:28.584925 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-665e44e4-645d-460e-a87e-5224981e766d req-b87262c9-1c1b-4757-a07f-a77c52837586 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:28.596973 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-665e44e4-645d-460e-a87e-5224981e766d req-b87262c9-1c1b-4757-a07f-a77c52837586 service nova] Creating event network-changed:73ff051a-40d0-4991-a964-6aa8322f9de5 for instance da518ab7-8778-41f2-b6e0-66740a427a16 on hv-cinder-85236 Aug 26 11:15:28.603176 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-665e44e4-645d-460e-a87e-5224981e766d req-b87262c9-1c1b-4757-a07f-a77c52837586 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040254 Aug 26 11:15:28.603788 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 497/1015] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:15:28.932634 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-22264d9a-aec3-4719-a639-b7f1e776aba1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:28.933729 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-22264d9a-aec3-4719-a639-b7f1e776aba1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:28.941781 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22264d9a-aec3-4719-a639-b7f1e776aba1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:28.942313 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22264d9a-aec3-4719-a639-b7f1e776aba1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:28.942748 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22264d9a-aec3-4719-a639-b7f1e776aba1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:28.943483 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22264d9a-aec3-4719-a639-b7f1e776aba1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:28.943979 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22264d9a-aec3-4719-a639-b7f1e776aba1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:28.944432 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22264d9a-aec3-4719-a639-b7f1e776aba1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:29.132328 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-22264d9a-aec3-4719-a639-b7f1e776aba1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:29.140417 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-22264d9a-aec3-4719-a639-b7f1e776aba1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1266 microversion: 2.1 time: 0.212873 Aug 26 11:15:29.141067 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 519/1016] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:28 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:29.459291 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-dd04e711-00a6-4e99-b718-353d7f1e7212 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:29.460167 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-dd04e711-00a6-4e99-b718-353d7f1e7212 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:29.467284 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd04e711-00a6-4e99-b718-353d7f1e7212 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:29.468584 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd04e711-00a6-4e99-b718-353d7f1e7212 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:29.469237 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd04e711-00a6-4e99-b718-353d7f1e7212 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:29.469967 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd04e711-00a6-4e99-b718-353d7f1e7212 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:29.470511 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd04e711-00a6-4e99-b718-353d7f1e7212 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:29.470937 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd04e711-00a6-4e99-b718-353d7f1e7212 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:29.633721 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-dd04e711-00a6-4e99-b718-353d7f1e7212 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:29.641957 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-dd04e711-00a6-4e99-b718-353d7f1e7212 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1260 microversion: 2.1 time: 0.187096 Aug 26 11:15:29.642830 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 498/1017] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:29 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:30.163111 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-822d99f1-1c49-43c6-8a20-5a057696d78b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:30.163991 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-822d99f1-1c49-43c6-8a20-5a057696d78b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:30.166714 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:15:30.172015 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-822d99f1-1c49-43c6-8a20-5a057696d78b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:30.172506 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-822d99f1-1c49-43c6-8a20-5a057696d78b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:30.172947 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-822d99f1-1c49-43c6-8a20-5a057696d78b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:30.173684 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-822d99f1-1c49-43c6-8a20-5a057696d78b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:30.174163 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-822d99f1-1c49-43c6-8a20-5a057696d78b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:30.175294 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-822d99f1-1c49-43c6-8a20-5a057696d78b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:30.179645 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:15:30.320288 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-822d99f1-1c49-43c6-8a20-5a057696d78b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:30.328512 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-822d99f1-1c49-43c6-8a20-5a057696d78b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1266 microversion: 2.1 time: 0.170112 Aug 26 11:15:30.329574 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 520/1018] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:30 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:30.665124 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-28619f31-7dc6-4066-ac5f-d7859fe353a0 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:30.665745 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-28619f31-7dc6-4066-ac5f-d7859fe353a0 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:30.668253 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:15:30.673607 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28619f31-7dc6-4066-ac5f-d7859fe353a0 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:30.674378 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28619f31-7dc6-4066-ac5f-d7859fe353a0 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:30.675390 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28619f31-7dc6-4066-ac5f-d7859fe353a0 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:30.676433 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28619f31-7dc6-4066-ac5f-d7859fe353a0 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:30.676926 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28619f31-7dc6-4066-ac5f-d7859fe353a0 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:30.677360 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28619f31-7dc6-4066-ac5f-d7859fe353a0 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:30.682985 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:15:30.827453 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-28619f31-7dc6-4066-ac5f-d7859fe353a0 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:30.836448 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-28619f31-7dc6-4066-ac5f-d7859fe353a0 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1260 microversion: 2.1 time: 0.175345 Aug 26 11:15:30.837032 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 499/1019] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:30 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:31.350264 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f4ac14a7-cd21-4bad-9fb3-329734e0fc76 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:31.350879 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f4ac14a7-cd21-4bad-9fb3-329734e0fc76 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:31.357132 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4ac14a7-cd21-4bad-9fb3-329734e0fc76 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:31.357615 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4ac14a7-cd21-4bad-9fb3-329734e0fc76 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:31.358073 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4ac14a7-cd21-4bad-9fb3-329734e0fc76 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:31.358762 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4ac14a7-cd21-4bad-9fb3-329734e0fc76 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:31.359208 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4ac14a7-cd21-4bad-9fb3-329734e0fc76 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:31.359623 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f4ac14a7-cd21-4bad-9fb3-329734e0fc76 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:31.511238 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f4ac14a7-cd21-4bad-9fb3-329734e0fc76 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:31.520273 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f4ac14a7-cd21-4bad-9fb3-329734e0fc76 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1266 microversion: 2.1 time: 0.174662 Aug 26 11:15:31.521273 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 521/1020] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:31 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:31.857852 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2661b1f8-903d-4a60-8543-8488f9d6f2f1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:31.858556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2661b1f8-903d-4a60-8543-8488f9d6f2f1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:31.865291 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2661b1f8-903d-4a60-8543-8488f9d6f2f1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:31.865778 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2661b1f8-903d-4a60-8543-8488f9d6f2f1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:31.866241 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2661b1f8-903d-4a60-8543-8488f9d6f2f1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:31.866942 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2661b1f8-903d-4a60-8543-8488f9d6f2f1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:31.867391 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2661b1f8-903d-4a60-8543-8488f9d6f2f1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:31.868079 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2661b1f8-903d-4a60-8543-8488f9d6f2f1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:32.017458 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2661b1f8-903d-4a60-8543-8488f9d6f2f1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:32.026843 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2661b1f8-903d-4a60-8543-8488f9d6f2f1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1260 microversion: 2.1 time: 0.172751 Aug 26 11:15:32.027415 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 500/1021] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:31 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:32.548055 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-10888bf1-e7d4-47eb-841f-7716ba5a9df5 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:32.548680 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-10888bf1-e7d4-47eb-841f-7716ba5a9df5 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:32.556478 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-10888bf1-e7d4-47eb-841f-7716ba5a9df5 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:32.557052 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-10888bf1-e7d4-47eb-841f-7716ba5a9df5 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:32.557597 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-10888bf1-e7d4-47eb-841f-7716ba5a9df5 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:32.558421 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-10888bf1-e7d4-47eb-841f-7716ba5a9df5 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:32.558955 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-10888bf1-e7d4-47eb-841f-7716ba5a9df5 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:32.559461 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-10888bf1-e7d4-47eb-841f-7716ba5a9df5 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:32.727557 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-10888bf1-e7d4-47eb-841f-7716ba5a9df5 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:32.738440 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-10888bf1-e7d4-47eb-841f-7716ba5a9df5 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1266 microversion: 2.1 time: 0.194144 Aug 26 11:15:32.739449 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 522/1022] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:32 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:15:32.771864 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-37b66300-5164-496e-bfde-2b704df96540 req-95e18a5d-f2aa-473f-8e7b-a1a847261e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ca2d22c-594f-47aa-9933-e2679fa45d7f", "name": "network-vif-plugged", "status": "completed", "tag": "f1a9a75b-57a5-451f-a187-16c7dd13630c"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:15:32.782367 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-37b66300-5164-496e-bfde-2b704df96540 req-95e18a5d-f2aa-473f-8e7b-a1a847261e3b service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:32.783114 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-37b66300-5164-496e-bfde-2b704df96540 req-95e18a5d-f2aa-473f-8e7b-a1a847261e3b service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:32.783621 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-37b66300-5164-496e-bfde-2b704df96540 req-95e18a5d-f2aa-473f-8e7b-a1a847261e3b service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:32.796009 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-37b66300-5164-496e-bfde-2b704df96540 req-95e18a5d-f2aa-473f-8e7b-a1a847261e3b service nova] Creating event network-vif-plugged:f1a9a75b-57a5-451f-a187-16c7dd13630c for instance 9ca2d22c-594f-47aa-9933-e2679fa45d7f on hv-cinder-85236 Aug 26 11:15:32.801382 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-37b66300-5164-496e-bfde-2b704df96540 req-95e18a5d-f2aa-473f-8e7b-a1a847261e3b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206867 Aug 26 11:15:32.802112 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 501/1023] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:15:33.048002 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-536cc9b0-ea00-42df-8f5f-d3f539c5bfe8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:33.048722 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-536cc9b0-ea00-42df-8f5f-d3f539c5bfe8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:33.057323 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-536cc9b0-ea00-42df-8f5f-d3f539c5bfe8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:33.057824 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-536cc9b0-ea00-42df-8f5f-d3f539c5bfe8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:33.058574 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-536cc9b0-ea00-42df-8f5f-d3f539c5bfe8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:33.059295 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-536cc9b0-ea00-42df-8f5f-d3f539c5bfe8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:33.060089 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-536cc9b0-ea00-42df-8f5f-d3f539c5bfe8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:33.060202 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-536cc9b0-ea00-42df-8f5f-d3f539c5bfe8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:33.219755 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-536cc9b0-ea00-42df-8f5f-d3f539c5bfe8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:33.228489 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-536cc9b0-ea00-42df-8f5f-d3f539c5bfe8 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1260 microversion: 2.1 time: 0.184300 Aug 26 11:15:33.229295 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 523/1024] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:33 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:33.761451 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1ac3c0f9-0ed4-4c8c-bffd-b70aa5462854 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:33.762355 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1ac3c0f9-0ed4-4c8c-bffd-b70aa5462854 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:33.769175 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1ac3c0f9-0ed4-4c8c-bffd-b70aa5462854 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:33.769731 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1ac3c0f9-0ed4-4c8c-bffd-b70aa5462854 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:33.770476 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1ac3c0f9-0ed4-4c8c-bffd-b70aa5462854 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:33.771281 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1ac3c0f9-0ed4-4c8c-bffd-b70aa5462854 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:33.771795 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1ac3c0f9-0ed4-4c8c-bffd-b70aa5462854 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:33.772214 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1ac3c0f9-0ed4-4c8c-bffd-b70aa5462854 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:33.923526 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1ac3c0f9-0ed4-4c8c-bffd-b70aa5462854 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:33.933907 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1ac3c0f9-0ed4-4c8c-bffd-b70aa5462854 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1266 microversion: 2.1 time: 0.177594 Aug 26 11:15:33.934593 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 502/1025] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:33 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:34.248560 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-18036255-28b5-464b-a47a-7fa1dd82b5b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:34.249153 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-18036255-28b5-464b-a47a-7fa1dd82b5b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:34.259080 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-18036255-28b5-464b-a47a-7fa1dd82b5b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:34.259775 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-18036255-28b5-464b-a47a-7fa1dd82b5b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:34.260612 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-18036255-28b5-464b-a47a-7fa1dd82b5b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:34.261359 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-18036255-28b5-464b-a47a-7fa1dd82b5b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:34.262302 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-18036255-28b5-464b-a47a-7fa1dd82b5b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:34.262797 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-18036255-28b5-464b-a47a-7fa1dd82b5b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:34.427292 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-18036255-28b5-464b-a47a-7fa1dd82b5b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:34.436055 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-18036255-28b5-464b-a47a-7fa1dd82b5b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1444 microversion: 2.1 time: 0.191263 Aug 26 11:15:34.436659 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 524/1026] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:34 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1444 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:34.462046 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-18966929-5868-4a4c-b3cc-79394ad6c492 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:34.462677 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-18966929-5868-4a4c-b3cc-79394ad6c492 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:34.468877 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-18966929-5868-4a4c-b3cc-79394ad6c492 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:34.469377 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-18966929-5868-4a4c-b3cc-79394ad6c492 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:34.469817 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-18966929-5868-4a4c-b3cc-79394ad6c492 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:34.470559 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-18966929-5868-4a4c-b3cc-79394ad6c492 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:34.471017 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-18966929-5868-4a4c-b3cc-79394ad6c492 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:34.471492 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-18966929-5868-4a4c-b3cc-79394ad6c492 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:34.611731 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-18966929-5868-4a4c-b3cc-79394ad6c492 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:34.620430 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-18966929-5868-4a4c-b3cc-79394ad6c492 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1444 microversion: 2.1 time: 0.162202 Aug 26 11:15:34.621018 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 503/1027] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:34 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:34.955830 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-e6346b8c-717a-495f-af77-a819af0b22eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:34.957210 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e6346b8c-717a-495f-af77-a819af0b22eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:34.963670 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e6346b8c-717a-495f-af77-a819af0b22eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:34.964427 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e6346b8c-717a-495f-af77-a819af0b22eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:34.965032 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e6346b8c-717a-495f-af77-a819af0b22eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:34.965899 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e6346b8c-717a-495f-af77-a819af0b22eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:34.966525 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e6346b8c-717a-495f-af77-a819af0b22eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:34.967417 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e6346b8c-717a-495f-af77-a819af0b22eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:35.214005 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-e6346b8c-717a-495f-af77-a819af0b22eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:35.223271 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-e6346b8c-717a-495f-af77-a819af0b22eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1266 microversion: 2.1 time: 0.271270 Aug 26 11:15:35.223856 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 525/1028] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:34 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:15:36.253238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b73481a6-feeb-4232-b295-3387f03bc236 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:36.254102 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b73481a6-feeb-4232-b295-3387f03bc236 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:36.257435 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=4 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:15:36.261586 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b73481a6-feeb-4232-b295-3387f03bc236 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:36.262466 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b73481a6-feeb-4232-b295-3387f03bc236 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:36.263129 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b73481a6-feeb-4232-b295-3387f03bc236 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:36.263868 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b73481a6-feeb-4232-b295-3387f03bc236 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:36.264336 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b73481a6-feeb-4232-b295-3387f03bc236 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:36.264762 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b73481a6-feeb-4232-b295-3387f03bc236 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:36.506013 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b73481a6-feeb-4232-b295-3387f03bc236 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:36.516602 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b73481a6-feeb-4232-b295-3387f03bc236 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1266 microversion: 2.1 time: 0.267870 Aug 26 11:15:36.517420 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 504/1029] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:36 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:36.811409 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=4 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:15:36.812333 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell0:SELECT=12 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:15:37.059995 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-4f4c98b9-d8d0-4e20-95cb-095b5ac4e0ee req-d907fe98-ccd6-44c1-8364-f99b39230095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ca2d22c-594f-47aa-9933-e2679fa45d7f", "tag": "f1a9a75b-57a5-451f-a187-16c7dd13630c"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:15:37.071230 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-4f4c98b9-d8d0-4e20-95cb-095b5ac4e0ee req-d907fe98-ccd6-44c1-8364-f99b39230095 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:37.071720 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-4f4c98b9-d8d0-4e20-95cb-095b5ac4e0ee req-d907fe98-ccd6-44c1-8364-f99b39230095 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:37.072159 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-4f4c98b9-d8d0-4e20-95cb-095b5ac4e0ee req-d907fe98-ccd6-44c1-8364-f99b39230095 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:37.084810 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-4f4c98b9-d8d0-4e20-95cb-095b5ac4e0ee req-d907fe98-ccd6-44c1-8364-f99b39230095 service nova] Creating event network-changed:f1a9a75b-57a5-451f-a187-16c7dd13630c for instance 9ca2d22c-594f-47aa-9933-e2679fa45d7f on hv-cinder-85236 Aug 26 11:15:37.090550 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-4f4c98b9-d8d0-4e20-95cb-095b5ac4e0ee req-d907fe98-ccd6-44c1-8364-f99b39230095 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.279577 Aug 26 11:15:37.091424 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 526/1030] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:15:37.544897 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f4443e1c-f471-425d-b6d4-a06c1d839501 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:37.546624 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f4443e1c-f471-425d-b6d4-a06c1d839501 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:37.555147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f4443e1c-f471-425d-b6d4-a06c1d839501 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:37.556607 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f4443e1c-f471-425d-b6d4-a06c1d839501 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:37.557384 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f4443e1c-f471-425d-b6d4-a06c1d839501 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:37.558479 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f4443e1c-f471-425d-b6d4-a06c1d839501 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:37.559164 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f4443e1c-f471-425d-b6d4-a06c1d839501 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:37.559794 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f4443e1c-f471-425d-b6d4-a06c1d839501 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:37.730242 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f4443e1c-f471-425d-b6d4-a06c1d839501 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:37.748326 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f4443e1c-f471-425d-b6d4-a06c1d839501 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1266 microversion: 2.1 time: 0.211096 Aug 26 11:15:37.748936 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 505/1031] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:37 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:38.771590 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a4e4a822-2db2-454f-a9c4-660a7fc079f8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:38.772372 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-a4e4a822-2db2-454f-a9c4-660a7fc079f8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:38.778780 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a4e4a822-2db2-454f-a9c4-660a7fc079f8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:38.779360 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a4e4a822-2db2-454f-a9c4-660a7fc079f8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:38.779890 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a4e4a822-2db2-454f-a9c4-660a7fc079f8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:38.780733 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a4e4a822-2db2-454f-a9c4-660a7fc079f8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:38.781253 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a4e4a822-2db2-454f-a9c4-660a7fc079f8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:38.781745 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a4e4a822-2db2-454f-a9c4-660a7fc079f8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:38.948863 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-a4e4a822-2db2-454f-a9c4-660a7fc079f8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:38.957890 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-a4e4a822-2db2-454f-a9c4-660a7fc079f8 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1266 microversion: 2.1 time: 0.191360 Aug 26 11:15:38.958523 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 527/1032] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:38 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:39.979175 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-68d3bf72-438a-4fa9-9f59-f9570c49cd53 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:39.979814 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-68d3bf72-438a-4fa9-9f59-f9570c49cd53 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:39.986416 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68d3bf72-438a-4fa9-9f59-f9570c49cd53 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:39.987052 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68d3bf72-438a-4fa9-9f59-f9570c49cd53 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:39.987598 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68d3bf72-438a-4fa9-9f59-f9570c49cd53 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:39.988327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68d3bf72-438a-4fa9-9f59-f9570c49cd53 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:39.988786 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68d3bf72-438a-4fa9-9f59-f9570c49cd53 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:39.991400 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68d3bf72-438a-4fa9-9f59-f9570c49cd53 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:40.133357 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-68d3bf72-438a-4fa9-9f59-f9570c49cd53 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:40.141851 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-68d3bf72-438a-4fa9-9f59-f9570c49cd53 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1266 microversion: 2.1 time: 0.166500 Aug 26 11:15:40.142472 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 506/1033] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:39 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:40.619473 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-f314639a-cb98-4fb1-a7ec-cdc78bfed4be req-0e40389b-21fe-429c-8d2b-80f295b4743e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da518ab7-8778-41f2-b6e0-66740a427a16", "name": "network-vif-plugged", "status": "completed", "tag": "73ff051a-40d0-4991-a964-6aa8322f9de5"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:15:40.631295 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f314639a-cb98-4fb1-a7ec-cdc78bfed4be req-0e40389b-21fe-429c-8d2b-80f295b4743e service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:40.632101 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f314639a-cb98-4fb1-a7ec-cdc78bfed4be req-0e40389b-21fe-429c-8d2b-80f295b4743e service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:40.632640 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f314639a-cb98-4fb1-a7ec-cdc78bfed4be req-0e40389b-21fe-429c-8d2b-80f295b4743e service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:40.647582 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-f314639a-cb98-4fb1-a7ec-cdc78bfed4be req-0e40389b-21fe-429c-8d2b-80f295b4743e service nova] Creating event network-vif-plugged:73ff051a-40d0-4991-a964-6aa8322f9de5 for instance da518ab7-8778-41f2-b6e0-66740a427a16 on hv-cinder-85236 Aug 26 11:15:40.652817 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-f314639a-cb98-4fb1-a7ec-cdc78bfed4be req-0e40389b-21fe-429c-8d2b-80f295b4743e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037074 Aug 26 11:15:40.653424 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 528/1034] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:15:41.166201 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7a42b78a-6a0b-46ee-b94d-39f8079701eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:41.166771 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7a42b78a-6a0b-46ee-b94d-39f8079701eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:41.174464 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7a42b78a-6a0b-46ee-b94d-39f8079701eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:41.176022 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7a42b78a-6a0b-46ee-b94d-39f8079701eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:41.176567 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7a42b78a-6a0b-46ee-b94d-39f8079701eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:41.177604 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7a42b78a-6a0b-46ee-b94d-39f8079701eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:41.178662 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7a42b78a-6a0b-46ee-b94d-39f8079701eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:41.179174 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7a42b78a-6a0b-46ee-b94d-39f8079701eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:41.334139 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7a42b78a-6a0b-46ee-b94d-39f8079701eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:41.342775 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7a42b78a-6a0b-46ee-b94d-39f8079701eb tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1266 microversion: 2.1 time: 0.182486 Aug 26 11:15:41.343375 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 507/1035] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:41 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:42.365808 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f18ecc16-d5ef-4204-9626-dc38581d4d5d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:42.366742 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f18ecc16-d5ef-4204-9626-dc38581d4d5d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:42.373176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f18ecc16-d5ef-4204-9626-dc38581d4d5d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:42.373698 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f18ecc16-d5ef-4204-9626-dc38581d4d5d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:42.374160 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f18ecc16-d5ef-4204-9626-dc38581d4d5d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:42.374867 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f18ecc16-d5ef-4204-9626-dc38581d4d5d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:42.375320 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f18ecc16-d5ef-4204-9626-dc38581d4d5d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:42.376005 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f18ecc16-d5ef-4204-9626-dc38581d4d5d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:42.514604 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f18ecc16-d5ef-4204-9626-dc38581d4d5d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:42.523386 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f18ecc16-d5ef-4204-9626-dc38581d4d5d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1453 microversion: 2.1 time: 0.162635 Aug 26 11:15:42.523966 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 529/1036] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:42 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:15:42.544785 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-85d65449-1810-4fce-afff-d90c2a588d56 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:15:42.545659 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-85d65449-1810-4fce-afff-d90c2a588d56 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:15:42.554348 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85d65449-1810-4fce-afff-d90c2a588d56 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:42.555004 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85d65449-1810-4fce-afff-d90c2a588d56 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:42.555551 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85d65449-1810-4fce-afff-d90c2a588d56 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:42.556403 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85d65449-1810-4fce-afff-d90c2a588d56 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:42.557375 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85d65449-1810-4fce-afff-d90c2a588d56 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:42.557880 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85d65449-1810-4fce-afff-d90c2a588d56 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:42.704943 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-85d65449-1810-4fce-afff-d90c2a588d56 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:15:42.713941 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-85d65449-1810-4fce-afff-d90c2a588d56 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1453 microversion: 2.1 time: 0.172942 Aug 26 11:15:42.714557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 508/1037] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:15:42 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:15:44.626473 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-f6b76743-3c65-4a6f-b543-4156766ea3e6 req-686d2132-355b-4643-b83b-9a5ac25bdfc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da518ab7-8778-41f2-b6e0-66740a427a16", "tag": "73ff051a-40d0-4991-a964-6aa8322f9de5"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:15:44.637432 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f6b76743-3c65-4a6f-b543-4156766ea3e6 req-686d2132-355b-4643-b83b-9a5ac25bdfc7 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:15:44.637912 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f6b76743-3c65-4a6f-b543-4156766ea3e6 req-686d2132-355b-4643-b83b-9a5ac25bdfc7 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:15:44.638560 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-f6b76743-3c65-4a6f-b543-4156766ea3e6 req-686d2132-355b-4643-b83b-9a5ac25bdfc7 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:15:44.651416 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-f6b76743-3c65-4a6f-b543-4156766ea3e6 req-686d2132-355b-4643-b83b-9a5ac25bdfc7 service nova] Creating event network-changed:73ff051a-40d0-4991-a964-6aa8322f9de5 for instance da518ab7-8778-41f2-b6e0-66740a427a16 on hv-cinder-85236 Aug 26 11:15:44.656432 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-f6b76743-3c65-4a6f-b543-4156766ea3e6 req-686d2132-355b-4643-b83b-9a5ac25bdfc7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194012 Aug 26 11:15:44.657042 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 530/1038] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:17:37.445487 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=19 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:17:37.449628 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6bf4bd81-5722-423a-9297-dec8c27842d0] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 26 11:17:37.450249 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=21 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:17:37.450975 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=53 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:17:37.452234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 26 11:17:37.452418 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Fri Aug 26 11:17:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Aug 26 11:17:37.453329 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=55 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:17:37.454412 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 11:17:37.454566 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Fri Aug 26 11:17:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 (ip 10.222.0.40) !!! Aug 26 11:17:37.459850 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a84c4792-99d0-4363-ace9-e4149a6cfea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:37.460352 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a84c4792-99d0-4363-ace9-e4149a6cfea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:37.470406 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-a362a9f6-ca6e-4a36-8e43-37d947d75a23 req-bd63eec9-5b3d-4ae7-a143-f931574b50c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da518ab7-8778-41f2-b6e0-66740a427a16", "tag": "73ff051a-40d0-4991-a964-6aa8322f9de5"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:17:37.483873 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a84c4792-99d0-4363-ace9-e4149a6cfea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:37.484877 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a84c4792-99d0-4363-ace9-e4149a6cfea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:37.485434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a84c4792-99d0-4363-ace9-e4149a6cfea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:37.486418 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a84c4792-99d0-4363-ace9-e4149a6cfea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:37.487024 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a84c4792-99d0-4363-ace9-e4149a6cfea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:37.487678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a84c4792-99d0-4363-ace9-e4149a6cfea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:37.488591 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-a362a9f6-ca6e-4a36-8e43-37d947d75a23 req-bd63eec9-5b3d-4ae7-a143-f931574b50c6 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:37.489278 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-a362a9f6-ca6e-4a36-8e43-37d947d75a23 req-bd63eec9-5b3d-4ae7-a143-f931574b50c6 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:37.489709 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-a362a9f6-ca6e-4a36-8e43-37d947d75a23 req-bd63eec9-5b3d-4ae7-a143-f931574b50c6 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:37.500580 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-a362a9f6-ca6e-4a36-8e43-37d947d75a23 req-bd63eec9-5b3d-4ae7-a143-f931574b50c6 service nova] Creating event network-changed:73ff051a-40d0-4991-a964-6aa8322f9de5 for instance da518ab7-8778-41f2-b6e0-66740a427a16 on hv-cinder-85236 Aug 26 11:17:37.506257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-a362a9f6-ca6e-4a36-8e43-37d947d75a23 req-bd63eec9-5b3d-4ae7-a143-f931574b50c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058769 Aug 26 11:17:37.506854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 531/1039] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:17:37.516373 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a84c4792-99d0-4363-ace9-e4149a6cfea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:17:37.602353 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a84c4792-99d0-4363-ace9-e4149a6cfea7 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "DELETE /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 204 len: 0 microversion: 2.1 time: 0.158695 Aug 26 11:17:37.606081 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 509/1040] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:17:37 2022] DELETE /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:17:37.615204 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-04959624-d6aa-4b61-b055-b2a774c75675 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:37.615937 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-04959624-d6aa-4b61-b055-b2a774c75675 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:37.626639 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-04959624-d6aa-4b61-b055-b2a774c75675 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:37.627591 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-04959624-d6aa-4b61-b055-b2a774c75675 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:37.628392 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-04959624-d6aa-4b61-b055-b2a774c75675 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:37.629651 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-04959624-d6aa-4b61-b055-b2a774c75675 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:37.630536 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-04959624-d6aa-4b61-b055-b2a774c75675 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:37.631326 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-04959624-d6aa-4b61-b055-b2a774c75675 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:37.776559 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-04959624-d6aa-4b61-b055-b2a774c75675 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:37.784573 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-04959624-d6aa-4b61-b055-b2a774c75675 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1578 microversion: 2.1 time: 0.176278 Aug 26 11:17:37.785160 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 532/1041] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:37 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:17:38.808517 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-95e9fbfe-bbda-4898-bdb1-2c2b13e87e26 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:38.809136 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-95e9fbfe-bbda-4898-bdb1-2c2b13e87e26 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:38.816220 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95e9fbfe-bbda-4898-bdb1-2c2b13e87e26 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:38.816703 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95e9fbfe-bbda-4898-bdb1-2c2b13e87e26 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:38.817138 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95e9fbfe-bbda-4898-bdb1-2c2b13e87e26 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:38.817825 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95e9fbfe-bbda-4898-bdb1-2c2b13e87e26 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:38.818332 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95e9fbfe-bbda-4898-bdb1-2c2b13e87e26 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:38.818818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95e9fbfe-bbda-4898-bdb1-2c2b13e87e26 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:38.959158 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-95e9fbfe-bbda-4898-bdb1-2c2b13e87e26 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:38.967545 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-95e9fbfe-bbda-4898-bdb1-2c2b13e87e26 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1578 microversion: 2.1 time: 0.164005 Aug 26 11:17:38.968110 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 510/1042] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:38 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:17:39.914417 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-cc88a411-a9be-49d3-81a4-be2bb4a920b4 req-35bea889-6351-4d2a-bcc7-fd66405075af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da518ab7-8778-41f2-b6e0-66740a427a16", "name": "network-vif-deleted", "tag": "73ff051a-40d0-4991-a964-6aa8322f9de5"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:17:39.926364 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-cc88a411-a9be-49d3-81a4-be2bb4a920b4 req-35bea889-6351-4d2a-bcc7-fd66405075af service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:39.926850 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-cc88a411-a9be-49d3-81a4-be2bb4a920b4 req-35bea889-6351-4d2a-bcc7-fd66405075af service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:39.927391 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-cc88a411-a9be-49d3-81a4-be2bb4a920b4 req-35bea889-6351-4d2a-bcc7-fd66405075af service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:39.941118 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-cc88a411-a9be-49d3-81a4-be2bb4a920b4 req-35bea889-6351-4d2a-bcc7-fd66405075af service nova] Creating event network-vif-deleted:73ff051a-40d0-4991-a964-6aa8322f9de5 for instance da518ab7-8778-41f2-b6e0-66740a427a16 on hv-cinder-85236 Aug 26 11:17:39.946703 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-cc88a411-a9be-49d3-81a4-be2bb4a920b4 req-35bea889-6351-4d2a-bcc7-fd66405075af service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036020 Aug 26 11:17:39.947312 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 533/1043] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:17:39.988652 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-53216735-3a00-4b66-af0c-c17b958051f6 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:39.989262 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-53216735-3a00-4b66-af0c-c17b958051f6 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:39.995747 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53216735-3a00-4b66-af0c-c17b958051f6 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:39.996234 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53216735-3a00-4b66-af0c-c17b958051f6 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:39.996664 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53216735-3a00-4b66-af0c-c17b958051f6 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:39.997354 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53216735-3a00-4b66-af0c-c17b958051f6 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:39.997806 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53216735-3a00-4b66-af0c-c17b958051f6 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:39.998324 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53216735-3a00-4b66-af0c-c17b958051f6 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:40.064304 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-53216735-3a00-4b66-af0c-c17b958051f6 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:40.072220 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-53216735-3a00-4b66-af0c-c17b958051f6 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 200 len: 1225 microversion: 2.1 time: 0.087502 Aug 26 11:17:40.073318 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 511/1044] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:39 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:17:41.095430 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-22fba443-3aa4-4e98-afd9-3398fb5f2e21 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:41.096104 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-22fba443-3aa4-4e98-afd9-3398fb5f2e21 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: da518ab7-8778-41f2-b6e0-66740a427a16] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:41.098469 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO oslo.messaging._drivers.impl_rabbit [-] [6bf4bd81-5722-423a-9297-dec8c27842d0] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 51582. Aug 26 11:17:41.103506 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22fba443-3aa4-4e98-afd9-3398fb5f2e21 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:41.104030 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22fba443-3aa4-4e98-afd9-3398fb5f2e21 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:41.104485 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22fba443-3aa4-4e98-afd9-3398fb5f2e21 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:41.105191 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22fba443-3aa4-4e98-afd9-3398fb5f2e21 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:41.105648 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22fba443-3aa4-4e98-afd9-3398fb5f2e21 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:41.106116 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-22fba443-3aa4-4e98-afd9-3398fb5f2e21 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:41.121602 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-22fba443-3aa4-4e98-afd9-3398fb5f2e21 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] HTTP exception thrown: Instance da518ab7-8778-41f2-b6e0-66740a427a16 could not be found. Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-22fba443-3aa4-4e98-afd9-3398fb5f2e21 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Request method failure captured: Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 HTTP/1.1 Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKoH_-LbA9Rbs23oPrkIgCJE5CpgrKujLryDaAPkgg-OKVNJ7DV6wIiWdEEQ6XU-hsuyBzbTQd-4sDVZz9GxogqNH8VUw6N0KKu6dIweFRnG8ToTD8dkxqr8MbxvWVIVjUKQeUZkZMui7Knu2AfJ8oYCS5c0u4zXtOpu160VKpbq5mg Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: d773f20240a44729b159c57c80e017ef Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-TestVolumeBootPattern-609580237 Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:17:41.123261 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:17:41.125011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d773f20240a44729b159c57c80e017ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d773f20240a44729b159c57c80e017ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d773f20240a44729b159c57c80e017ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d773f20240a44729b159c57c80e017ef"}]}] Aug 26 11:17:41.125011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-TestVolumeBootPattern-609580237 Aug 26 11:17:41.125011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: d773f20240a44729b159c57c80e017ef Aug 26 11:17:41.125011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-TestVolumeBootPattern-609580237 Aug 26 11:17:41.125011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-TestVolumeBootPattern-609580237-project Aug 26 11:17:41.125011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:17:41.125011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:17:41.125011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: 9e8355dc324e49d881b9f0fc5c2923ad Aug 26 11:17:41.125011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-TestVolumeBootPattern-609580237-project Aug 26 11:17:41.125011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:17:41.125011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance da518ab7-8778-41f2-b6e0-66740a427a16 could not be found. Aug 26 11:17:41.125011 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': 'da518ab7-8778-41f2-b6e0-66740a427a16'} Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da518ab7-8778-41f2-b6e0-66740a427a16 could not be found. Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:17:41.126259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da518ab7-8778-41f2-b6e0-66740a427a16 could not be found. Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da518ab7-8778-41f2-b6e0-66740a427a16 could not be found. Aug 26 11:17:41.127946 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:17:41.129620 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-22fba443-3aa4-4e98-afd9-3398fb5f2e21 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Returning 404 to user: Instance da518ab7-8778-41f2-b6e0-66740a427a16 could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:17:41.129620 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-22fba443-3aa4-4e98-afd9-3398fb5f2e21 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16" status: 404 len: 111 microversion: 2.1 time: 0.034059 Aug 26 11:17:41.129620 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 534/1045] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:41 2022] GET /compute/v2.1/servers/da518ab7-8778-41f2-b6e0-66740a427a16 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:17:44.207361 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c433fc88-6c0b-4e5b-bff8-7644a41bf8ec tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:44.207896 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c433fc88-6c0b-4e5b-bff8-7644a41bf8ec tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:44.209992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-c391e688-3dd5-4b57-a68f-8afbf2431aac req-dc310015-a274-4ec5-9393-c705f9843678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e72f32-b26f-4799-b3c9-dd6352d5c100", "tag": "202f8947-cca0-41bf-9a36-01029ac31a92"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:17:44.215283 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c433fc88-6c0b-4e5b-bff8-7644a41bf8ec tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:44.215772 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c433fc88-6c0b-4e5b-bff8-7644a41bf8ec tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:44.216211 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c433fc88-6c0b-4e5b-bff8-7644a41bf8ec tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:44.216909 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c433fc88-6c0b-4e5b-bff8-7644a41bf8ec tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:44.217542 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c433fc88-6c0b-4e5b-bff8-7644a41bf8ec tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:44.217965 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c433fc88-6c0b-4e5b-bff8-7644a41bf8ec tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:44.221386 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-c391e688-3dd5-4b57-a68f-8afbf2431aac req-dc310015-a274-4ec5-9393-c705f9843678 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:44.222183 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-c391e688-3dd5-4b57-a68f-8afbf2431aac req-dc310015-a274-4ec5-9393-c705f9843678 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:44.222832 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-c391e688-3dd5-4b57-a68f-8afbf2431aac req-dc310015-a274-4ec5-9393-c705f9843678 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:44.237098 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-c391e688-3dd5-4b57-a68f-8afbf2431aac req-dc310015-a274-4ec5-9393-c705f9843678 service nova] Creating event network-changed:202f8947-cca0-41bf-9a36-01029ac31a92 for instance c8e72f32-b26f-4799-b3c9-dd6352d5c100 on hv-cinder-85236 Aug 26 11:17:44.244863 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-c391e688-3dd5-4b57-a68f-8afbf2431aac req-dc310015-a274-4ec5-9393-c705f9843678 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038766 Aug 26 11:17:44.245567 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 535/1046] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:17:44.247540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c433fc88-6c0b-4e5b-bff8-7644a41bf8ec tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:17:44.335708 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c433fc88-6c0b-4e5b-bff8-7644a41bf8ec tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 204 len: 0 microversion: 2.1 time: 0.132064 Aug 26 11:17:44.336548 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 512/1047] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:17:44 2022] DELETE /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:17:44.346037 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-e365f076-5090-4074-b6fd-241c2e502c7e tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:44.347205 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-e365f076-5090-4074-b6fd-241c2e502c7e tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:44.355880 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e365f076-5090-4074-b6fd-241c2e502c7e tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:44.356371 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e365f076-5090-4074-b6fd-241c2e502c7e tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:44.357134 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e365f076-5090-4074-b6fd-241c2e502c7e tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:44.358040 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e365f076-5090-4074-b6fd-241c2e502c7e tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:44.358677 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e365f076-5090-4074-b6fd-241c2e502c7e tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:44.359263 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-e365f076-5090-4074-b6fd-241c2e502c7e tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:44.502215 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-e365f076-5090-4074-b6fd-241c2e502c7e tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:44.509913 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-e365f076-5090-4074-b6fd-241c2e502c7e tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1577 microversion: 2.1 time: 0.168568 Aug 26 11:17:44.510529 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 536/1048] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:44 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:17:45.348992 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9de2252c-207e-4b2f-8b36-02ad79198904 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:17:45.349652 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9de2252c-207e-4b2f-8b36-02ad79198904 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:45.356810 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9de2252c-207e-4b2f-8b36-02ad79198904 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:45.357296 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9de2252c-207e-4b2f-8b36-02ad79198904 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:45.357736 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9de2252c-207e-4b2f-8b36-02ad79198904 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:45.358474 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9de2252c-207e-4b2f-8b36-02ad79198904 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:45.358956 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9de2252c-207e-4b2f-8b36-02ad79198904 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:45.359381 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9de2252c-207e-4b2f-8b36-02ad79198904 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:45.385476 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-9de2252c-207e-4b2f-8b36-02ad79198904 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lazy-loading 'flavor' on Instance uuid 9ca2d22c-594f-47aa-9933-e2679fa45d7f {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 11:17:45.460901 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9de2252c-207e-4b2f-8b36-02ad79198904 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "POST /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f/action" status: 202 len: 0 microversion: 2.1 time: 0.116065 Aug 26 11:17:45.461485 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 513/1049] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 11:17:45 2022] POST /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:17:45.470745 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-a104bd05-e229-4365-b921-4c266b53e9fb tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:45.471363 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-a104bd05-e229-4365-b921-4c266b53e9fb tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:45.477671 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a104bd05-e229-4365-b921-4c266b53e9fb tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:45.478207 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a104bd05-e229-4365-b921-4c266b53e9fb tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:45.478650 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a104bd05-e229-4365-b921-4c266b53e9fb tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:45.479353 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a104bd05-e229-4365-b921-4c266b53e9fb tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:45.480028 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a104bd05-e229-4365-b921-4c266b53e9fb tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:45.480428 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-a104bd05-e229-4365-b921-4c266b53e9fb tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:45.533440 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-766b096f-d8b0-488f-b81d-2503ffcc8cb0 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:45.534783 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-766b096f-d8b0-488f-b81d-2503ffcc8cb0 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:45.542105 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-766b096f-d8b0-488f-b81d-2503ffcc8cb0 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:45.542588 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-766b096f-d8b0-488f-b81d-2503ffcc8cb0 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:45.543155 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-766b096f-d8b0-488f-b81d-2503ffcc8cb0 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:45.543874 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-766b096f-d8b0-488f-b81d-2503ffcc8cb0 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:45.544349 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-766b096f-d8b0-488f-b81d-2503ffcc8cb0 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:45.544765 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-766b096f-d8b0-488f-b81d-2503ffcc8cb0 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:45.665066 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-a104bd05-e229-4365-b921-4c266b53e9fb tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:45.677662 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-a104bd05-e229-4365-b921-4c266b53e9fb tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1569 microversion: 2.1 time: 0.210723 Aug 26 11:17:45.678517 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 537/1050] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:45 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:17:45.722585 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-766b096f-d8b0-488f-b81d-2503ffcc8cb0 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:45.730322 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-766b096f-d8b0-488f-b81d-2503ffcc8cb0 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1577 microversion: 2.1 time: 0.202160 Aug 26 11:17:45.730887 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 514/1051] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:45 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:17:46.666489 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-9fb7a3bf-7a9e-464a-b3b2-2e18b4b36642 req-8b8aa19d-e797-4968-b418-38d2af7de3de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e72f32-b26f-4799-b3c9-dd6352d5c100", "name": "network-vif-deleted", "tag": "202f8947-cca0-41bf-9a36-01029ac31a92"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:17:46.677234 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-9fb7a3bf-7a9e-464a-b3b2-2e18b4b36642 req-8b8aa19d-e797-4968-b418-38d2af7de3de service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:46.677713 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-9fb7a3bf-7a9e-464a-b3b2-2e18b4b36642 req-8b8aa19d-e797-4968-b418-38d2af7de3de service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:46.678183 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-9fb7a3bf-7a9e-464a-b3b2-2e18b4b36642 req-8b8aa19d-e797-4968-b418-38d2af7de3de service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:46.689915 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-9fb7a3bf-7a9e-464a-b3b2-2e18b4b36642 req-8b8aa19d-e797-4968-b418-38d2af7de3de service nova] Creating event network-vif-deleted:202f8947-cca0-41bf-9a36-01029ac31a92 for instance c8e72f32-b26f-4799-b3c9-dd6352d5c100 on hv-cinder-85236 Aug 26 11:17:46.695084 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-9fb7a3bf-7a9e-464a-b3b2-2e18b4b36642 req-8b8aa19d-e797-4968-b418-38d2af7de3de service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032264 Aug 26 11:17:46.695669 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 538/1052] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:17:46.699464 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9b86c2b4-b452-4232-b309-cc65c48daa2e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:46.700157 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9b86c2b4-b452-4232-b309-cc65c48daa2e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:46.706792 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9b86c2b4-b452-4232-b309-cc65c48daa2e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:46.707637 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9b86c2b4-b452-4232-b309-cc65c48daa2e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:46.708163 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9b86c2b4-b452-4232-b309-cc65c48daa2e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:46.708930 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9b86c2b4-b452-4232-b309-cc65c48daa2e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:46.709551 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9b86c2b4-b452-4232-b309-cc65c48daa2e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:46.709998 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9b86c2b4-b452-4232-b309-cc65c48daa2e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:46.752762 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-573985b5-093b-4098-9c95-fc6c2d5b1b5b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:46.753463 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-573985b5-093b-4098-9c95-fc6c2d5b1b5b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:46.759936 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-573985b5-093b-4098-9c95-fc6c2d5b1b5b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:46.760618 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-573985b5-093b-4098-9c95-fc6c2d5b1b5b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:46.761088 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-573985b5-093b-4098-9c95-fc6c2d5b1b5b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:46.761856 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-573985b5-093b-4098-9c95-fc6c2d5b1b5b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:46.762361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-573985b5-093b-4098-9c95-fc6c2d5b1b5b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:46.762786 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-573985b5-093b-4098-9c95-fc6c2d5b1b5b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:46.834810 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-573985b5-093b-4098-9c95-fc6c2d5b1b5b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8355dc324e49d881b9f0fc5c2923ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd773f20240a44729b159c57c80e017ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:46.843175 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-573985b5-093b-4098-9c95-fc6c2d5b1b5b tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 200 len: 1225 microversion: 2.1 time: 0.094971 Aug 26 11:17:46.844096 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 539/1053] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:46 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:17:46.868589 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9b86c2b4-b452-4232-b309-cc65c48daa2e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:46.880421 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9b86c2b4-b452-4232-b309-cc65c48daa2e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1569 microversion: 2.1 time: 0.185622 Aug 26 11:17:46.881003 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 515/1054] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:46 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:17:47.865318 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b008a57e-6095-44b7-a271-2b231a4f192d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:47.865856 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b008a57e-6095-44b7-a271-2b231a4f192d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: c8e72f32-b26f-4799-b3c9-dd6352d5c100] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:47.873183 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b008a57e-6095-44b7-a271-2b231a4f192d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:47.873672 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b008a57e-6095-44b7-a271-2b231a4f192d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:47.874141 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b008a57e-6095-44b7-a271-2b231a4f192d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:47.874845 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b008a57e-6095-44b7-a271-2b231a4f192d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:47.875302 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b008a57e-6095-44b7-a271-2b231a4f192d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:47.875729 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b008a57e-6095-44b7-a271-2b231a4f192d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:47.889662 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-b008a57e-6095-44b7-a271-2b231a4f192d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] HTTP exception thrown: Instance c8e72f32-b26f-4799-b3c9-dd6352d5c100 could not be found. Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b008a57e-6095-44b7-a271-2b231a4f192d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Request method failure captured: Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 HTTP/1.1 Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKoH_-LbA9Rbs23oPrkIgCJE5CpgrKujLryDaAPkgg-OKVNJ7DV6wIiWdEEQ6XU-hsuyBzbTQd-4sDVZz9GxogqNH8VUw6N0KKu6dIweFRnG8ToTD8dkxqr8MbxvWVIVjUKQeUZkZMui7Knu2AfJ8oYCS5c0u4zXtOpu160VKpbq5mg Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: d773f20240a44729b159c57c80e017ef Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-TestVolumeBootPattern-609580237 Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:17:47.891351 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:17:47.892996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d773f20240a44729b159c57c80e017ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d773f20240a44729b159c57c80e017ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d773f20240a44729b159c57c80e017ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d773f20240a44729b159c57c80e017ef"}]}] Aug 26 11:17:47.892996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-TestVolumeBootPattern-609580237 Aug 26 11:17:47.892996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: d773f20240a44729b159c57c80e017ef Aug 26 11:17:47.892996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-TestVolumeBootPattern-609580237 Aug 26 11:17:47.892996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-TestVolumeBootPattern-609580237-project Aug 26 11:17:47.892996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:17:47.892996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:17:47.892996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: 9e8355dc324e49d881b9f0fc5c2923ad Aug 26 11:17:47.892996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-TestVolumeBootPattern-609580237-project Aug 26 11:17:47.892996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:17:47.892996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance c8e72f32-b26f-4799-b3c9-dd6352d5c100 could not be found. Aug 26 11:17:47.892996 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': 'c8e72f32-b26f-4799-b3c9-dd6352d5c100'} Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e72f32-b26f-4799-b3c9-dd6352d5c100 could not be found. Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:17:47.894841 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e72f32-b26f-4799-b3c9-dd6352d5c100 could not be found. Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e72f32-b26f-4799-b3c9-dd6352d5c100 could not be found. Aug 26 11:17:47.897962 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:17:47.899881 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b008a57e-6095-44b7-a271-2b231a4f192d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Returning 404 to user: Instance c8e72f32-b26f-4799-b3c9-dd6352d5c100 could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:17:47.899881 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b008a57e-6095-44b7-a271-2b231a4f192d tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100" status: 404 len: 111 microversion: 2.1 time: 0.031536 Aug 26 11:17:47.899881 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 540/1055] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:47 2022] GET /compute/v2.1/servers/c8e72f32-b26f-4799-b3c9-dd6352d5c100 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:17:47.901906 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5d9cae44-fa64-4e2e-bb30-06f6a92bec65 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:47.902748 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5d9cae44-fa64-4e2e-bb30-06f6a92bec65 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:47.909064 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d9cae44-fa64-4e2e-bb30-06f6a92bec65 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:47.909554 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d9cae44-fa64-4e2e-bb30-06f6a92bec65 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:47.910015 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d9cae44-fa64-4e2e-bb30-06f6a92bec65 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:47.910726 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d9cae44-fa64-4e2e-bb30-06f6a92bec65 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:47.911183 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d9cae44-fa64-4e2e-bb30-06f6a92bec65 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:47.911616 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d9cae44-fa64-4e2e-bb30-06f6a92bec65 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:48.050657 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5d9cae44-fa64-4e2e-bb30-06f6a92bec65 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:48.059079 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5d9cae44-fa64-4e2e-bb30-06f6a92bec65 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1569 microversion: 2.1 time: 0.160987 Aug 26 11:17:48.059668 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 516/1056] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:47 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:17:48.578519 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-fda78500-2e32-4bbb-9d45-564ffd0c6316 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:48.579040 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-fda78500-2e32-4bbb-9d45-564ffd0c6316 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:48.584919 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fda78500-2e32-4bbb-9d45-564ffd0c6316 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:48.585394 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fda78500-2e32-4bbb-9d45-564ffd0c6316 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:48.585823 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fda78500-2e32-4bbb-9d45-564ffd0c6316 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:48.586536 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fda78500-2e32-4bbb-9d45-564ffd0c6316 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:48.586987 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fda78500-2e32-4bbb-9d45-564ffd0c6316 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:48.587404 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-fda78500-2e32-4bbb-9d45-564ffd0c6316 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:48.601335 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-fda78500-2e32-4bbb-9d45-564ffd0c6316 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] HTTP exception thrown: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-fda78500-2e32-4bbb-9d45-564ffd0c6316 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Request method failure captured: Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: DELETE /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b HTTP/1.1 Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKoH_-LbA9Rbs23oPrkIgCJE5CpgrKujLryDaAPkgg-OKVNJ7DV6wIiWdEEQ6XU-hsuyBzbTQd-4sDVZz9GxogqNH8VUw6N0KKu6dIweFRnG8ToTD8dkxqr8MbxvWVIVjUKQeUZkZMui7Knu2AfJ8oYCS5c0u4zXtOpu160VKpbq5mg Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: d773f20240a44729b159c57c80e017ef Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-TestVolumeBootPattern-609580237 Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:17:48.602907 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:17:48.605257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d773f20240a44729b159c57c80e017ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d773f20240a44729b159c57c80e017ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d773f20240a44729b159c57c80e017ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d773f20240a44729b159c57c80e017ef"}]}] Aug 26 11:17:48.605257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-TestVolumeBootPattern-609580237 Aug 26 11:17:48.605257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: d773f20240a44729b159c57c80e017ef Aug 26 11:17:48.605257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-TestVolumeBootPattern-609580237 Aug 26 11:17:48.605257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-TestVolumeBootPattern-609580237-project Aug 26 11:17:48.605257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:17:48.605257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:17:48.605257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: 9e8355dc324e49d881b9f0fc5c2923ad Aug 26 11:17:48.605257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-TestVolumeBootPattern-609580237-project Aug 26 11:17:48.605257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:17:48.605257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. Aug 26 11:17:48.605257 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': 'd5e7d29e-0b68-4fea-9855-e1250c542c1b'} Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:17:48.606361 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. Aug 26 11:17:48.607992 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:17:48.609674 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-fda78500-2e32-4bbb-9d45-564ffd0c6316 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Returning 404 to user: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:17:48.609674 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-fda78500-2e32-4bbb-9d45-564ffd0c6316 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 404 len: 111 microversion: 2.1 time: 0.030417 Aug 26 11:17:48.609674 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 541/1057] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:17:48 2022] DELETE /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:17:48.614677 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5e99c8a7-3772-49ed-a8c1-d416ad5a38e1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:48.615315 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5e99c8a7-3772-49ed-a8c1-d416ad5a38e1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] [instance: d5e7d29e-0b68-4fea-9855-e1250c542c1b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:48.621778 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5e99c8a7-3772-49ed-a8c1-d416ad5a38e1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:48.622283 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5e99c8a7-3772-49ed-a8c1-d416ad5a38e1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:48.622719 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5e99c8a7-3772-49ed-a8c1-d416ad5a38e1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:48.623407 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5e99c8a7-3772-49ed-a8c1-d416ad5a38e1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:48.623858 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5e99c8a7-3772-49ed-a8c1-d416ad5a38e1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:48.624284 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5e99c8a7-3772-49ed-a8c1-d416ad5a38e1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:48.637960 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-5e99c8a7-3772-49ed-a8c1-d416ad5a38e1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] HTTP exception thrown: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5e99c8a7-3772-49ed-a8c1-d416ad5a38e1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Request method failure captured: Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b HTTP/1.1 Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept: application/json Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Connection: close Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Length: 0 Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Content-Type: application/json Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Host: 10.222.0.40 Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.11 Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjCKoH_-LbA9Rbs23oPrkIgCJE5CpgrKujLryDaAPkgg-OKVNJ7DV6wIiWdEEQ6XU-hsuyBzbTQd-4sDVZz9GxogqNH8VUw6N0KKu6dIweFRnG8ToTD8dkxqr8MbxvWVIVjUKQeUZkZMui7Knu2AfJ8oYCS5c0u4zXtOpu160VKpbq5mg Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Id: d773f20240a44729b159c57c80e017ef Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-TestVolumeBootPattern-609580237 Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Role: member,reader Aug 26 11:17:48.639678 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Roles: member,reader Aug 26 11:17:48.641406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d773f20240a44729b159c57c80e017ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d773f20240a44729b159c57c80e017ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d773f20240a44729b159c57c80e017ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d773f20240a44729b159c57c80e017ef"}]}] Aug 26 11:17:48.641406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-TestVolumeBootPattern-609580237 Aug 26 11:17:48.641406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Id: d773f20240a44729b159c57c80e017ef Aug 26 11:17:48.641406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-TestVolumeBootPattern-609580237 Aug 26 11:17:48.641406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User: tempest-TestVolumeBootPattern-609580237-project Aug 26 11:17:48.641406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Aug 26 11:17:48.641406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Aug 26 11:17:48.641406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Id: 9e8355dc324e49d881b9f0fc5c2923ad Aug 26 11:17:48.641406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-TestVolumeBootPattern-609580237-project Aug 26 11:17:48.641406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: method: > Aug 26 11:17:48.641406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: exception: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. Aug 26 11:17:48.641406 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: action_args: {'id': 'd5e7d29e-0b68-4fea-9855-e1250c542c1b'} Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:17:48.643113 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. Aug 26 11:17:48.644818 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Aug 26 11:17:48.646253 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5e99c8a7-3772-49ed-a8c1-d416ad5a38e1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Returning 404 to user: Instance d5e7d29e-0b68-4fea-9855-e1250c542c1b could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:17:48.646253 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5e99c8a7-3772-49ed-a8c1-d416ad5a38e1 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b" status: 404 len: 111 microversion: 2.1 time: 0.030259 Aug 26 11:17:48.646253 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 517/1058] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:48 2022] GET /compute/v2.1/servers/d5e7d29e-0b68-4fea-9855-e1250c542c1b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:17:49.080713 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5629f2ce-6d21-425e-91f9-251df7005c73 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:49.081315 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5629f2ce-6d21-425e-91f9-251df7005c73 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:49.087602 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5629f2ce-6d21-425e-91f9-251df7005c73 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:49.088086 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5629f2ce-6d21-425e-91f9-251df7005c73 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:49.088520 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5629f2ce-6d21-425e-91f9-251df7005c73 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:49.089711 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5629f2ce-6d21-425e-91f9-251df7005c73 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:49.090270 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5629f2ce-6d21-425e-91f9-251df7005c73 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:49.090707 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5629f2ce-6d21-425e-91f9-251df7005c73 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:49.224692 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5629f2ce-6d21-425e-91f9-251df7005c73 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:49.233307 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5629f2ce-6d21-425e-91f9-251df7005c73 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1569 microversion: 2.1 time: 0.156613 Aug 26 11:17:49.233873 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 542/1059] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:49 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:17:49.942933 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-fa6b9319-e722-49b7-b80d-fcea341d1123 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] Calling method '.version_select at 0x7f1a689c2670>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:49.965286 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-fa6b9319-e722-49b7-b80d-fcea341d1123 tempest-TestVolumeBootPattern-609580237 tempest-TestVolumeBootPattern-609580237-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-246835179" status: 202 len: 0 microversion: 2.1 time: 0.025980 Aug 26 11:17:49.965896 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 518/1060] 10.222.0.40 () {58 vars in 1260 bytes} [Fri Aug 26 11:17:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-246835179 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 11:17:50.255403 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-f0523d13-b68d-426c-9ad7-6061e69e355e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:50.256008 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-f0523d13-b68d-426c-9ad7-6061e69e355e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:50.263191 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f0523d13-b68d-426c-9ad7-6061e69e355e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:50.263983 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f0523d13-b68d-426c-9ad7-6061e69e355e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:50.264765 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f0523d13-b68d-426c-9ad7-6061e69e355e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:50.265869 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f0523d13-b68d-426c-9ad7-6061e69e355e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:50.266752 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f0523d13-b68d-426c-9ad7-6061e69e355e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:50.267506 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-f0523d13-b68d-426c-9ad7-6061e69e355e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:50.488247 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-f0523d13-b68d-426c-9ad7-6061e69e355e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:50.497739 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-f0523d13-b68d-426c-9ad7-6061e69e355e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1569 microversion: 2.1 time: 0.246403 Aug 26 11:17:50.498354 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 543/1061] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:50 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:17:51.519830 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-34268d37-c221-48dd-87a6-abec7c9a8d30 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:51.520434 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-34268d37-c221-48dd-87a6-abec7c9a8d30 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:51.529006 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-34268d37-c221-48dd-87a6-abec7c9a8d30 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:51.529412 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-34268d37-c221-48dd-87a6-abec7c9a8d30 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:51.529849 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-34268d37-c221-48dd-87a6-abec7c9a8d30 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:51.530595 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-34268d37-c221-48dd-87a6-abec7c9a8d30 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:51.531207 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-34268d37-c221-48dd-87a6-abec7c9a8d30 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:51.531638 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-34268d37-c221-48dd-87a6-abec7c9a8d30 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:51.785302 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-34268d37-c221-48dd-87a6-abec7c9a8d30 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:51.794279 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-34268d37-c221-48dd-87a6-abec7c9a8d30 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1569 microversion: 2.1 time: 0.278403 Aug 26 11:17:51.794937 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 519/1062] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:51 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1569 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:17:52.817159 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-3596fb15-7377-4008-94fd-d60c355d0c32 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:52.818477 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-3596fb15-7377-4008-94fd-d60c355d0c32 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:52.825438 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3596fb15-7377-4008-94fd-d60c355d0c32 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:52.825944 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3596fb15-7377-4008-94fd-d60c355d0c32 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:52.826409 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3596fb15-7377-4008-94fd-d60c355d0c32 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:52.827306 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3596fb15-7377-4008-94fd-d60c355d0c32 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:52.827783 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3596fb15-7377-4008-94fd-d60c355d0c32 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:52.828595 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-3596fb15-7377-4008-94fd-d60c355d0c32 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:53.015614 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-3596fb15-7377-4008-94fd-d60c355d0c32 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:53.023671 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-3596fb15-7377-4008-94fd-d60c355d0c32 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1569 microversion: 2.1 time: 0.211228 Aug 26 11:17:53.024255 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 544/1063] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:52 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:17:54.046376 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9b8573a2-7dff-45d5-b530-b41c088928ad tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:54.047022 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9b8573a2-7dff-45d5-b530-b41c088928ad tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:54.054777 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9b8573a2-7dff-45d5-b530-b41c088928ad tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:54.055267 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9b8573a2-7dff-45d5-b530-b41c088928ad tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:54.055704 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9b8573a2-7dff-45d5-b530-b41c088928ad tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:54.056408 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9b8573a2-7dff-45d5-b530-b41c088928ad tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:54.056866 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9b8573a2-7dff-45d5-b530-b41c088928ad tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:54.057292 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9b8573a2-7dff-45d5-b530-b41c088928ad tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:54.283516 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9b8573a2-7dff-45d5-b530-b41c088928ad tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:54.292607 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9b8573a2-7dff-45d5-b530-b41c088928ad tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1569 microversion: 2.1 time: 0.250369 Aug 26 11:17:54.293556 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 520/1064] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:54 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1569 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:17:55.317787 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-6cb27562-d100-4ffa-872b-7ac45c83f444 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:55.319722 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-6cb27562-d100-4ffa-872b-7ac45c83f444 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:55.329426 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6cb27562-d100-4ffa-872b-7ac45c83f444 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:55.330259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6cb27562-d100-4ffa-872b-7ac45c83f444 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:55.331017 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6cb27562-d100-4ffa-872b-7ac45c83f444 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:55.332332 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6cb27562-d100-4ffa-872b-7ac45c83f444 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:55.333048 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6cb27562-d100-4ffa-872b-7ac45c83f444 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:55.333639 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6cb27562-d100-4ffa-872b-7ac45c83f444 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:55.552796 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6cb27562-d100-4ffa-872b-7ac45c83f444 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:55.561379 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-6cb27562-d100-4ffa-872b-7ac45c83f444 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1569 microversion: 2.1 time: 0.249703 Aug 26 11:17:55.561956 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 545/1065] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:55 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1569 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:17:56.588469 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-eeda95f9-f8e1-489f-8345-94d38817e223 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:56.591138 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-eeda95f9-f8e1-489f-8345-94d38817e223 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:56.611134 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eeda95f9-f8e1-489f-8345-94d38817e223 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:56.612546 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eeda95f9-f8e1-489f-8345-94d38817e223 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:56.614403 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eeda95f9-f8e1-489f-8345-94d38817e223 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:56.615439 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eeda95f9-f8e1-489f-8345-94d38817e223 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:56.616948 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eeda95f9-f8e1-489f-8345-94d38817e223 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:56.618086 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eeda95f9-f8e1-489f-8345-94d38817e223 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:56.892186 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-eeda95f9-f8e1-489f-8345-94d38817e223 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:56.896277 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:17:56.902971 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-eeda95f9-f8e1-489f-8345-94d38817e223 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1569 microversion: 2.1 time: 0.323212 Aug 26 11:17:56.903750 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 521/1066] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:56 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1569 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:17:57.924030 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-4e1a8e13-1f3f-4536-9035-48f9114c6589 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:57.924791 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-4e1a8e13-1f3f-4536-9035-48f9114c6589 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:57.931707 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e1a8e13-1f3f-4536-9035-48f9114c6589 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:57.932202 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e1a8e13-1f3f-4536-9035-48f9114c6589 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:57.933157 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e1a8e13-1f3f-4536-9035-48f9114c6589 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:57.933874 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e1a8e13-1f3f-4536-9035-48f9114c6589 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:57.934360 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e1a8e13-1f3f-4536-9035-48f9114c6589 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:57.934787 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-4e1a8e13-1f3f-4536-9035-48f9114c6589 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:58.084325 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-4e1a8e13-1f3f-4536-9035-48f9114c6589 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:58.092725 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-4e1a8e13-1f3f-4536-9035-48f9114c6589 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1569 microversion: 2.1 time: 0.172646 Aug 26 11:17:58.093317 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 546/1067] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:57 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:17:59.114464 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e58607f8-bf34-4d54-beaa-923873544542 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:17:59.115147 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e58607f8-bf34-4d54-beaa-923873544542 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:17:59.123591 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e58607f8-bf34-4d54-beaa-923873544542 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:59.124123 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e58607f8-bf34-4d54-beaa-923873544542 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:59.124573 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e58607f8-bf34-4d54-beaa-923873544542 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:59.125373 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e58607f8-bf34-4d54-beaa-923873544542 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:17:59.126243 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e58607f8-bf34-4d54-beaa-923873544542 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:17:59.126791 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e58607f8-bf34-4d54-beaa-923873544542 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:17:59.274940 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e58607f8-bf34-4d54-beaa-923873544542 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:17:59.283413 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e58607f8-bf34-4d54-beaa-923873544542 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1569 microversion: 2.1 time: 0.173094 Aug 26 11:17:59.284072 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 522/1068] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:17:59 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:00.304710 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-2628c294-562b-4ecf-81ca-ba910e810dc9 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:00.305325 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-2628c294-562b-4ecf-81ca-ba910e810dc9 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:00.311791 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2628c294-562b-4ecf-81ca-ba910e810dc9 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:00.312286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2628c294-562b-4ecf-81ca-ba910e810dc9 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:00.312726 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2628c294-562b-4ecf-81ca-ba910e810dc9 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:00.313425 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2628c294-562b-4ecf-81ca-ba910e810dc9 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:00.313880 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2628c294-562b-4ecf-81ca-ba910e810dc9 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:00.314348 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2628c294-562b-4ecf-81ca-ba910e810dc9 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:00.455111 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-2628c294-562b-4ecf-81ca-ba910e810dc9 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:00.462743 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-2628c294-562b-4ecf-81ca-ba910e810dc9 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1510 microversion: 2.1 time: 0.161938 Aug 26 11:18:00.463311 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 547/1069] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:00 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:00.485183 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6e188cd4-7c17-43e6-84af-c9c3f1f62007 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:18:00.485788 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6e188cd4-7c17-43e6-84af-c9c3f1f62007 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:00.492186 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6e188cd4-7c17-43e6-84af-c9c3f1f62007 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:00.492672 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6e188cd4-7c17-43e6-84af-c9c3f1f62007 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:00.493114 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6e188cd4-7c17-43e6-84af-c9c3f1f62007 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:00.493810 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6e188cd4-7c17-43e6-84af-c9c3f1f62007 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:00.494319 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6e188cd4-7c17-43e6-84af-c9c3f1f62007 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:00.494746 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6e188cd4-7c17-43e6-84af-c9c3f1f62007 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:00.680426 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6e188cd4-7c17-43e6-84af-c9c3f1f62007 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120604) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 11:18:00.750562 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6e188cd4-7c17-43e6-84af-c9c3f1f62007 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "POST /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f/action" status: 202 len: 0 microversion: 2.1 time: 0.269210 Aug 26 11:18:00.751809 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 523/1070] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 11:18:00 2022] POST /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 11:18:00.760545 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b31203c1-34fa-4013-b766-d35026373994 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:00.761730 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b31203c1-34fa-4013-b766-d35026373994 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:00.769791 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b31203c1-34fa-4013-b766-d35026373994 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:00.770346 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b31203c1-34fa-4013-b766-d35026373994 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:00.770840 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b31203c1-34fa-4013-b766-d35026373994 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:00.771647 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b31203c1-34fa-4013-b766-d35026373994 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:00.772172 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b31203c1-34fa-4013-b766-d35026373994 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:00.772663 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b31203c1-34fa-4013-b766-d35026373994 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:00.949411 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b31203c1-34fa-4013-b766-d35026373994 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:00.958509 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b31203c1-34fa-4013-b766-d35026373994 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1518 microversion: 2.1 time: 0.202714 Aug 26 11:18:00.959444 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 548/1071] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:00 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1518 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:18:01.981804 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d66f9723-36fe-402a-8e69-67ee5d2700e1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:01.982545 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d66f9723-36fe-402a-8e69-67ee5d2700e1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:01.988540 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d66f9723-36fe-402a-8e69-67ee5d2700e1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:01.989033 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d66f9723-36fe-402a-8e69-67ee5d2700e1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:01.989471 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d66f9723-36fe-402a-8e69-67ee5d2700e1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:01.990205 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d66f9723-36fe-402a-8e69-67ee5d2700e1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:01.990664 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d66f9723-36fe-402a-8e69-67ee5d2700e1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:01.991092 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d66f9723-36fe-402a-8e69-67ee5d2700e1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:02.162547 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d66f9723-36fe-402a-8e69-67ee5d2700e1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:02.170446 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d66f9723-36fe-402a-8e69-67ee5d2700e1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1518 microversion: 2.1 time: 0.193787 Aug 26 11:18:02.171034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 524/1072] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:01 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1518 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:03.192538 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-72a6904b-d92d-4171-b865-443c07ab847d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:03.193136 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-72a6904b-d92d-4171-b865-443c07ab847d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:03.200833 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-72a6904b-d92d-4171-b865-443c07ab847d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:03.201318 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-72a6904b-d92d-4171-b865-443c07ab847d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:03.201754 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-72a6904b-d92d-4171-b865-443c07ab847d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:03.202495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-72a6904b-d92d-4171-b865-443c07ab847d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:03.202942 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-72a6904b-d92d-4171-b865-443c07ab847d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:03.203357 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-72a6904b-d92d-4171-b865-443c07ab847d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:03.293239 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-2448c9c7-e871-423d-95f7-4b31d05776e8 req-3fbf1a5b-62f2-4617-bf99-606e45a9f4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ca2d22c-594f-47aa-9933-e2679fa45d7f", "name": "network-vif-unplugged", "status": "completed", "tag": "f1a9a75b-57a5-451f-a187-16c7dd13630c"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:18:03.311946 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-2448c9c7-e871-423d-95f7-4b31d05776e8 req-3fbf1a5b-62f2-4617-bf99-606e45a9f4ef service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:03.312432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-2448c9c7-e871-423d-95f7-4b31d05776e8 req-3fbf1a5b-62f2-4617-bf99-606e45a9f4ef service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:03.312864 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-2448c9c7-e871-423d-95f7-4b31d05776e8 req-3fbf1a5b-62f2-4617-bf99-606e45a9f4ef service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:03.330469 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.compute.server_external_events [req-2448c9c7-e871-423d-95f7-4b31d05776e8 req-3fbf1a5b-62f2-4617-bf99-606e45a9f4ef service nova] Unable to find a host for instance 9ca2d22c-594f-47aa-9933-e2679fa45d7f. Dropping event network-vif-unplugged {{(pid=120604) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 26 11:18:03.332032 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-2448c9c7-e871-423d-95f7-4b31d05776e8 req-3fbf1a5b-62f2-4617-bf99-606e45a9f4ef service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042681 Aug 26 11:18:03.333131 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 525/1073] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 26 11:18:03.381563 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-72a6904b-d92d-4171-b865-443c07ab847d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:03.390470 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-72a6904b-d92d-4171-b865-443c07ab847d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1518 microversion: 2.1 time: 0.201864 Aug 26 11:18:03.391043 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 549/1074] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:03 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1518 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:04.412880 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-db924cc8-7ae0-4f40-9a83-db97a3c3a367 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:04.413490 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-db924cc8-7ae0-4f40-9a83-db97a3c3a367 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:04.422638 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-db924cc8-7ae0-4f40-9a83-db97a3c3a367 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:04.423253 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-db924cc8-7ae0-4f40-9a83-db97a3c3a367 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:04.423747 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-db924cc8-7ae0-4f40-9a83-db97a3c3a367 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:04.424535 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-db924cc8-7ae0-4f40-9a83-db97a3c3a367 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:04.425039 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-db924cc8-7ae0-4f40-9a83-db97a3c3a367 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:04.425513 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-db924cc8-7ae0-4f40-9a83-db97a3c3a367 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:04.570862 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-db924cc8-7ae0-4f40-9a83-db97a3c3a367 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:04.580942 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-db924cc8-7ae0-4f40-9a83-db97a3c3a367 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1518 microversion: 2.1 time: 0.172182 Aug 26 11:18:04.581503 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 526/1075] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:04 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:05.603114 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-2d0082d7-8edb-4764-a9f2-61f56d90e58e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:05.603737 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-2d0082d7-8edb-4764-a9f2-61f56d90e58e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:05.610887 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2d0082d7-8edb-4764-a9f2-61f56d90e58e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:05.611374 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2d0082d7-8edb-4764-a9f2-61f56d90e58e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:05.611808 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2d0082d7-8edb-4764-a9f2-61f56d90e58e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:05.612515 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2d0082d7-8edb-4764-a9f2-61f56d90e58e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:05.612967 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2d0082d7-8edb-4764-a9f2-61f56d90e58e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:05.613391 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2d0082d7-8edb-4764-a9f2-61f56d90e58e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:05.764922 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-2d0082d7-8edb-4764-a9f2-61f56d90e58e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:05.772623 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-2d0082d7-8edb-4764-a9f2-61f56d90e58e tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1520 microversion: 2.1 time: 0.173347 Aug 26 11:18:05.773190 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 550/1076] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:05 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:06.795118 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7cbad938-bc31-49e8-a975-593a7754f81b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:06.795960 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7cbad938-bc31-49e8-a975-593a7754f81b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:06.803557 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7cbad938-bc31-49e8-a975-593a7754f81b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:06.804131 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7cbad938-bc31-49e8-a975-593a7754f81b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:06.804643 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7cbad938-bc31-49e8-a975-593a7754f81b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:06.805365 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7cbad938-bc31-49e8-a975-593a7754f81b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:06.805820 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7cbad938-bc31-49e8-a975-593a7754f81b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:06.806273 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7cbad938-bc31-49e8-a975-593a7754f81b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:07.056983 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7cbad938-bc31-49e8-a975-593a7754f81b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:07.066260 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7cbad938-bc31-49e8-a975-593a7754f81b tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1576 microversion: 2.1 time: 0.275714 Aug 26 11:18:07.066831 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 527/1077] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:06 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1576 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:08.090505 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-2a038d23-d80d-4ad2-9604-9504252c59d3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:08.091215 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-2a038d23-d80d-4ad2-9604-9504252c59d3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:08.094153 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=41 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:18:08.102271 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2a038d23-d80d-4ad2-9604-9504252c59d3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:08.102950 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2a038d23-d80d-4ad2-9604-9504252c59d3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:08.103389 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2a038d23-d80d-4ad2-9604-9504252c59d3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:08.104088 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2a038d23-d80d-4ad2-9604-9504252c59d3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:08.104563 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2a038d23-d80d-4ad2-9604-9504252c59d3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:08.104982 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-2a038d23-d80d-4ad2-9604-9504252c59d3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:08.108218 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=93 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:18:08.251218 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-2a038d23-d80d-4ad2-9604-9504252c59d3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:08.260860 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-2a038d23-d80d-4ad2-9604-9504252c59d3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1576 microversion: 2.1 time: 0.175511 Aug 26 11:18:08.261576 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 551/1078] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:08 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:09.285611 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8f37abf2-6837-4808-8228-ca6fa65ad709 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:09.286242 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8f37abf2-6837-4808-8228-ca6fa65ad709 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:09.288849 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:18:09.295141 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8f37abf2-6837-4808-8228-ca6fa65ad709 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:09.295606 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8f37abf2-6837-4808-8228-ca6fa65ad709 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:09.296210 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8f37abf2-6837-4808-8228-ca6fa65ad709 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:09.297796 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8f37abf2-6837-4808-8228-ca6fa65ad709 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:09.298393 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8f37abf2-6837-4808-8228-ca6fa65ad709 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:09.298945 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8f37abf2-6837-4808-8228-ca6fa65ad709 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:09.446857 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8f37abf2-6837-4808-8228-ca6fa65ad709 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:09.455995 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8f37abf2-6837-4808-8228-ca6fa65ad709 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1576 microversion: 2.1 time: 0.176071 Aug 26 11:18:09.456568 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 528/1079] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:09 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:10.477878 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-309a3da3-32e3-4abb-8a04-e07ca8233f78 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:10.478432 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-309a3da3-32e3-4abb-8a04-e07ca8233f78 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:10.485222 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-309a3da3-32e3-4abb-8a04-e07ca8233f78 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:10.485705 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-309a3da3-32e3-4abb-8a04-e07ca8233f78 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:10.486174 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-309a3da3-32e3-4abb-8a04-e07ca8233f78 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:10.486863 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-309a3da3-32e3-4abb-8a04-e07ca8233f78 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:10.487342 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-309a3da3-32e3-4abb-8a04-e07ca8233f78 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:10.487746 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-309a3da3-32e3-4abb-8a04-e07ca8233f78 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:10.634556 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-309a3da3-32e3-4abb-8a04-e07ca8233f78 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:10.642259 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-309a3da3-32e3-4abb-8a04-e07ca8233f78 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1576 microversion: 2.1 time: 0.168503 Aug 26 11:18:10.642828 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 552/1080] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:10 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:11.665091 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6cd7a63b-35ed-44a5-983f-03563f86d9b6 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:11.665757 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6cd7a63b-35ed-44a5-983f-03563f86d9b6 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:11.672987 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6cd7a63b-35ed-44a5-983f-03563f86d9b6 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:11.674432 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6cd7a63b-35ed-44a5-983f-03563f86d9b6 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:11.674902 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6cd7a63b-35ed-44a5-983f-03563f86d9b6 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:11.675689 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6cd7a63b-35ed-44a5-983f-03563f86d9b6 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:11.676212 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6cd7a63b-35ed-44a5-983f-03563f86d9b6 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:11.676689 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6cd7a63b-35ed-44a5-983f-03563f86d9b6 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:11.817731 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6cd7a63b-35ed-44a5-983f-03563f86d9b6 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:11.826393 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6cd7a63b-35ed-44a5-983f-03563f86d9b6 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1576 microversion: 2.1 time: 0.165252 Aug 26 11:18:11.827034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 529/1081] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:11 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:12.849837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-b6aaf3e8-a78d-411c-8a54-52f43319d69c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:12.850586 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-b6aaf3e8-a78d-411c-8a54-52f43319d69c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:12.857643 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6aaf3e8-a78d-411c-8a54-52f43319d69c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:12.858178 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6aaf3e8-a78d-411c-8a54-52f43319d69c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:12.858673 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6aaf3e8-a78d-411c-8a54-52f43319d69c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:12.859480 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6aaf3e8-a78d-411c-8a54-52f43319d69c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:12.859950 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6aaf3e8-a78d-411c-8a54-52f43319d69c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:12.860413 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-b6aaf3e8-a78d-411c-8a54-52f43319d69c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:12.999096 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-b6aaf3e8-a78d-411c-8a54-52f43319d69c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:13.007894 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-b6aaf3e8-a78d-411c-8a54-52f43319d69c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1576 microversion: 2.1 time: 0.162312 Aug 26 11:18:13.008461 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 553/1082] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:12 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:14.029480 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-083264e0-b173-4ca4-826e-33d3b560e7e7 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:14.030401 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-083264e0-b173-4ca4-826e-33d3b560e7e7 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:14.036525 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-083264e0-b173-4ca4-826e-33d3b560e7e7 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:14.037026 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-083264e0-b173-4ca4-826e-33d3b560e7e7 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:14.037444 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-083264e0-b173-4ca4-826e-33d3b560e7e7 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:14.038729 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-083264e0-b173-4ca4-826e-33d3b560e7e7 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:14.039189 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-083264e0-b173-4ca4-826e-33d3b560e7e7 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:14.039613 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-083264e0-b173-4ca4-826e-33d3b560e7e7 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:14.174544 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-083264e0-b173-4ca4-826e-33d3b560e7e7 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:14.183858 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-083264e0-b173-4ca4-826e-33d3b560e7e7 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1576 microversion: 2.1 time: 0.158260 Aug 26 11:18:14.184994 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 530/1083] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:14 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:15.207497 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-c6aacb30-18c4-4f9d-9933-922c6db9f23a tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:15.208078 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-c6aacb30-18c4-4f9d-9933-922c6db9f23a tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:15.215206 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c6aacb30-18c4-4f9d-9933-922c6db9f23a tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:15.215696 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c6aacb30-18c4-4f9d-9933-922c6db9f23a tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:15.216135 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c6aacb30-18c4-4f9d-9933-922c6db9f23a tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:15.216836 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c6aacb30-18c4-4f9d-9933-922c6db9f23a tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:15.217296 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c6aacb30-18c4-4f9d-9933-922c6db9f23a tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:15.217770 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-c6aacb30-18c4-4f9d-9933-922c6db9f23a tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:15.357551 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-c6aacb30-18c4-4f9d-9933-922c6db9f23a tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:15.366636 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-c6aacb30-18c4-4f9d-9933-922c6db9f23a tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1576 microversion: 2.1 time: 0.164601 Aug 26 11:18:15.367213 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 554/1084] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:15 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:16.390034 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-56674b15-987c-40d1-974e-cf01603432c1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:16.390663 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-56674b15-987c-40d1-974e-cf01603432c1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:16.396969 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-56674b15-987c-40d1-974e-cf01603432c1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:16.398107 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-56674b15-987c-40d1-974e-cf01603432c1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:16.398546 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-56674b15-987c-40d1-974e-cf01603432c1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:16.399238 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-56674b15-987c-40d1-974e-cf01603432c1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:16.399694 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-56674b15-987c-40d1-974e-cf01603432c1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:16.400117 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-56674b15-987c-40d1-974e-cf01603432c1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:16.540208 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-56674b15-987c-40d1-974e-cf01603432c1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:16.548633 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-56674b15-987c-40d1-974e-cf01603432c1 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1576 microversion: 2.1 time: 0.162448 Aug 26 11:18:16.549275 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 531/1085] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:16 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:17.571808 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5d296e69-ab2a-4a29-9dca-0fcc30d988b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:17.572422 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5d296e69-ab2a-4a29-9dca-0fcc30d988b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:17.577831 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-58b66bc0-9380-4935-ba28-4986d540aa99 req-ee386172-43df-4847-bfaa-7ba2e4384ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ca2d22c-594f-47aa-9933-e2679fa45d7f", "name": "network-vif-plugged", "status": "completed", "tag": "f1a9a75b-57a5-451f-a187-16c7dd13630c"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:18:17.579100 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d296e69-ab2a-4a29-9dca-0fcc30d988b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:17.580020 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d296e69-ab2a-4a29-9dca-0fcc30d988b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:17.580144 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d296e69-ab2a-4a29-9dca-0fcc30d988b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:17.580949 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d296e69-ab2a-4a29-9dca-0fcc30d988b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:17.581713 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d296e69-ab2a-4a29-9dca-0fcc30d988b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:17.581918 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d296e69-ab2a-4a29-9dca-0fcc30d988b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:17.589464 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-58b66bc0-9380-4935-ba28-4986d540aa99 req-ee386172-43df-4847-bfaa-7ba2e4384ed4 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:17.589953 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-58b66bc0-9380-4935-ba28-4986d540aa99 req-ee386172-43df-4847-bfaa-7ba2e4384ed4 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:17.590426 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-58b66bc0-9380-4935-ba28-4986d540aa99 req-ee386172-43df-4847-bfaa-7ba2e4384ed4 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:17.602706 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-58b66bc0-9380-4935-ba28-4986d540aa99 req-ee386172-43df-4847-bfaa-7ba2e4384ed4 service nova] Creating event network-vif-plugged:f1a9a75b-57a5-451f-a187-16c7dd13630c for instance 9ca2d22c-594f-47aa-9933-e2679fa45d7f on hv-cinder-85236 Aug 26 11:18:17.608522 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-58b66bc0-9380-4935-ba28-4986d540aa99 req-ee386172-43df-4847-bfaa-7ba2e4384ed4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034350 Aug 26 11:18:17.609548 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 532/1086] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 11:18:17.724561 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5d296e69-ab2a-4a29-9dca-0fcc30d988b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:17.733462 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5d296e69-ab2a-4a29-9dca-0fcc30d988b3 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1576 microversion: 2.1 time: 0.166370 Aug 26 11:18:17.734030 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 555/1087] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:17 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:18.758509 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e508f84c-422b-43a7-845c-ace608da18e2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:18.759304 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e508f84c-422b-43a7-845c-ace608da18e2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:18.765398 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e508f84c-422b-43a7-845c-ace608da18e2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:18.765875 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e508f84c-422b-43a7-845c-ace608da18e2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:18.766327 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e508f84c-422b-43a7-845c-ace608da18e2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:18.767009 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e508f84c-422b-43a7-845c-ace608da18e2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:18.767462 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e508f84c-422b-43a7-845c-ace608da18e2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:18.767972 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e508f84c-422b-43a7-845c-ace608da18e2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:18.912124 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e508f84c-422b-43a7-845c-ace608da18e2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:18.920476 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e508f84c-422b-43a7-845c-ace608da18e2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1576 microversion: 2.1 time: 0.167176 Aug 26 11:18:18.921046 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 533/1088] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:18 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:18:19.942433 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-6c2fe8e9-1640-4203-a861-7fee8cecab5f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:18:19.943072 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-6c2fe8e9-1640-4203-a861-7fee8cecab5f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:18:19.950350 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6c2fe8e9-1640-4203-a861-7fee8cecab5f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:19.950837 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6c2fe8e9-1640-4203-a861-7fee8cecab5f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:19.951278 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6c2fe8e9-1640-4203-a861-7fee8cecab5f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:19.951977 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6c2fe8e9-1640-4203-a861-7fee8cecab5f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:18:19.952429 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6c2fe8e9-1640-4203-a861-7fee8cecab5f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:18:19.952854 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-6c2fe8e9-1640-4203-a861-7fee8cecab5f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:18:20.107096 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-6c2fe8e9-1640-4203-a861-7fee8cecab5f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:18:20.114912 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-6c2fe8e9-1640-4203-a861-7fee8cecab5f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1563 microversion: 2.1 time: 0.176416 Aug 26 11:18:20.115477 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 556/1089] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:18:19 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:19:39.752573 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=11 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:19:39.754253 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_api:SELECT=11 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:19:39.755026 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:19:39.755176 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG dbcounter [-] [120605] Writing DB stats nova_cell1:SELECT=35 {{(pid=120605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 11:19:39.755857 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 11:19:39.756063 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Fri Aug 26 11:19:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Aug 26 11:19:39.763265 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-c6aac103-d959-42ad-a147-7e910ea5eea8 req-25ec8309-b88a-458a-b5d4-eb89d2f2c2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ca2d22c-594f-47aa-9933-e2679fa45d7f", "tag": "f1a9a75b-57a5-451f-a187-16c7dd13630c"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:19:39.763794 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5deedc82-e11e-411e-ab49-39792fb1795d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:19:39.764580 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5deedc82-e11e-411e-ab49-39792fb1795d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:19:39.775813 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5deedc82-e11e-411e-ab49-39792fb1795d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:19:39.777269 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5deedc82-e11e-411e-ab49-39792fb1795d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:19:39.777772 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5deedc82-e11e-411e-ab49-39792fb1795d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:19:39.778572 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5deedc82-e11e-411e-ab49-39792fb1795d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:19:39.779309 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5deedc82-e11e-411e-ab49-39792fb1795d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:19:39.780693 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5deedc82-e11e-411e-ab49-39792fb1795d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:19:39.784873 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-c6aac103-d959-42ad-a147-7e910ea5eea8 req-25ec8309-b88a-458a-b5d4-eb89d2f2c2b9 service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:19:39.785423 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-c6aac103-d959-42ad-a147-7e910ea5eea8 req-25ec8309-b88a-458a-b5d4-eb89d2f2c2b9 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:19:39.785814 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-c6aac103-d959-42ad-a147-7e910ea5eea8 req-25ec8309-b88a-458a-b5d4-eb89d2f2c2b9 service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:19:39.799901 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-c6aac103-d959-42ad-a147-7e910ea5eea8 req-25ec8309-b88a-458a-b5d4-eb89d2f2c2b9 service nova] Creating event network-changed:f1a9a75b-57a5-451f-a187-16c7dd13630c for instance 9ca2d22c-594f-47aa-9933-e2679fa45d7f on hv-cinder-85236 Aug 26 11:19:39.806202 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-c6aac103-d959-42ad-a147-7e910ea5eea8 req-25ec8309-b88a-458a-b5d4-eb89d2f2c2b9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053385 Aug 26 11:19:39.807496 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 557/1090] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:19:39.812833 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5deedc82-e11e-411e-ab49-39792fb1795d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 11:19:39.911326 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5deedc82-e11e-411e-ab49-39792fb1795d tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 204 len: 0 microversion: 2.1 time: 0.161122 Aug 26 11:19:39.915138 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 534/1091] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 11:19:39 2022] DELETE /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 11:19:39.922454 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-5d6dc72f-1ccd-4c92-bff4-84a90d4a274c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:19:39.923537 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-5d6dc72f-1ccd-4c92-bff4-84a90d4a274c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:19:39.930412 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d6dc72f-1ccd-4c92-bff4-84a90d4a274c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:19:39.930916 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d6dc72f-1ccd-4c92-bff4-84a90d4a274c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:19:39.931359 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d6dc72f-1ccd-4c92-bff4-84a90d4a274c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:19:39.932064 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d6dc72f-1ccd-4c92-bff4-84a90d4a274c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:19:39.932525 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d6dc72f-1ccd-4c92-bff4-84a90d4a274c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:19:39.932952 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-5d6dc72f-1ccd-4c92-bff4-84a90d4a274c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:19:40.116049 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.policy [None req-5d6dc72f-1ccd-4c92-bff4-84a90d4a274c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120605) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:19:40.123979 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-5d6dc72f-1ccd-4c92-bff4-84a90d4a274c tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1569 microversion: 2.1 time: 0.207483 Aug 26 11:19:40.124565 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 558/1092] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:19:39 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 11:19:41.146259 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3d6ddc3c-afec-427f-91c0-df9602f3988f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:19:41.146967 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3d6ddc3c-afec-427f-91c0-df9602f3988f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:19:41.153456 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3d6ddc3c-afec-427f-91c0-df9602f3988f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:19:41.153937 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3d6ddc3c-afec-427f-91c0-df9602f3988f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:19:41.154467 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3d6ddc3c-afec-427f-91c0-df9602f3988f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:19:41.155241 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3d6ddc3c-afec-427f-91c0-df9602f3988f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:19:41.155739 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3d6ddc3c-afec-427f-91c0-df9602f3988f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:19:41.156237 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3d6ddc3c-afec-427f-91c0-df9602f3988f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:19:41.355393 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3d6ddc3c-afec-427f-91c0-df9602f3988f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:19:41.363418 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3d6ddc3c-afec-427f-91c0-df9602f3988f tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1569 microversion: 2.1 time: 0.221466 Aug 26 11:19:41.363986 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 535/1093] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:19:41 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:19:42.249844 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [req-c67586f6-ad98-4697-9b1e-dc0a9dc2f6bb req-16368231-2af9-4844-b1d3-dca1b3c8cd1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ca2d22c-594f-47aa-9933-e2679fa45d7f", "name": "network-vif-deleted", "tag": "f1a9a75b-57a5-451f-a187-16c7dd13630c"}]} {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 11:19:42.273824 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-c67586f6-ad98-4697-9b1e-dc0a9dc2f6bb req-16368231-2af9-4844-b1d3-dca1b3c8cd1d service nova] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:19:42.274309 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-c67586f6-ad98-4697-9b1e-dc0a9dc2f6bb req-16368231-2af9-4844-b1d3-dca1b3c8cd1d service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:19:42.274831 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [req-c67586f6-ad98-4697-9b1e-dc0a9dc2f6bb req-16368231-2af9-4844-b1d3-dca1b3c8cd1d service nova] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:19:42.288487 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.compute.server_external_events [req-c67586f6-ad98-4697-9b1e-dc0a9dc2f6bb req-16368231-2af9-4844-b1d3-dca1b3c8cd1d service nova] Creating event network-vif-deleted:f1a9a75b-57a5-451f-a187-16c7dd13630c for instance 9ca2d22c-594f-47aa-9933-e2679fa45d7f on hv-cinder-85236 Aug 26 11:19:42.293495 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [req-c67586f6-ad98-4697-9b1e-dc0a9dc2f6bb req-16368231-2af9-4844-b1d3-dca1b3c8cd1d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047845 Aug 26 11:19:42.294105 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 559/1094] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 11:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 11:19:42.385387 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-80397a0b-8372-4e49-920a-2d2af427dbf2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:19:42.386122 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-80397a0b-8372-4e49-920a-2d2af427dbf2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:19:42.393443 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-80397a0b-8372-4e49-920a-2d2af427dbf2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:19:42.393924 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-80397a0b-8372-4e49-920a-2d2af427dbf2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:19:42.394389 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-80397a0b-8372-4e49-920a-2d2af427dbf2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:19:42.395085 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-80397a0b-8372-4e49-920a-2d2af427dbf2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:19:42.395531 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-80397a0b-8372-4e49-920a-2d2af427dbf2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:19:42.395952 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-80397a0b-8372-4e49-920a-2d2af427dbf2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:19:42.460770 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-80397a0b-8372-4e49-920a-2d2af427dbf2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93bec07110aa4697ab59ced454a51f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84157876f945099fda5fcb9d3f6c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 11:19:42.469070 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-80397a0b-8372-4e49-920a-2d2af427dbf2 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 200 len: 1219 microversion: 2.1 time: 0.087756 Aug 26 11:19:42.469631 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 536/1095] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:19:42 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 11:19:43.491264 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-340175e7-277a-4488-8c76-e2736fe6b757 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '>' {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:19:43.491971 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.compute.api [None req-340175e7-277a-4488-8c76-e2736fe6b757 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] [instance: 9ca2d22c-594f-47aa-9933-e2679fa45d7f] Fetching instance by UUID {{(pid=120605) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 11:19:43.498690 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-340175e7-277a-4488-8c76-e2736fe6b757 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:19:43.499172 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-340175e7-277a-4488-8c76-e2736fe6b757 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:19:43.499742 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-340175e7-277a-4488-8c76-e2736fe6b757 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:19:43.500439 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-340175e7-277a-4488-8c76-e2736fe6b757 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Acquiring lock "51910246-b507-43fe-b5f6-535f38f61839" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 11:19:43.500894 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-340175e7-277a-4488-8c76-e2736fe6b757 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 11:19:43.501324 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG oslo_concurrency.lockutils [None req-340175e7-277a-4488-8c76-e2736fe6b757 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Lock "51910246-b507-43fe-b5f6-535f38f61839" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 11:19:43.514630 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.wsgi [None req-340175e7-277a-4488-8c76-e2736fe6b757 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] HTTP exception thrown: Instance 9ca2d22c-594f-47aa-9933-e2679fa45d7f could not be found. Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-340175e7-277a-4488-8c76-e2736fe6b757 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Request method failure captured: Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: request: GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f HTTP/1.1 Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept: application/json Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Accept-Encoding: identity Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Connection: close Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Length: 0 Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Content-Type: application/json Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Host: 10.222.0.40 Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: Openstack-System-Scope: None Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: User-Agent: python-urllib3/1.26.11 Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Auth-Token: gAAAAABjCKstPyRAnX6Z9scy0Va1xKtiG2rBY0dbt5Fpjov-7eBF0DimVynCJndXklPe41qpEXgS7-r7UZMqApWiFLqLknhfr4s6lpscAm-o14IVTlum4UxmU3i3IHuED994epa7KtC5sXfv_S_7oDE9IUt6932F4Sz5OE2vu1TfkJ_kx-TDmMc Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Id: None Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Domain-Name: None Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Identity-Status: Confirmed Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Is-Admin-Project: True Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Id: default Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Domain-Name: Default Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Id: 3d84157876f945099fda5fcb9d3f6c20 Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Project-Name: tempest-TestShelveInstance-1187523687 Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Role: member,reader Aug 26 11:19:43.516286 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Roles: member,reader Aug 26 11:19:43.518135 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3d84157876f945099fda5fcb9d3f6c20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3d84157876f945099fda5fcb9d3f6c20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3d84157876f945099fda5fcb9d3f6c20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3d84157876f945099fda5fcb9d3f6c20"}]}] Aug 26 11:19:43.518135 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant: tempest-TestShelveInstance-1187523687 Aug 26 11:19:43.518135 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Id: 3d84157876f945099fda5fcb9d3f6c20 Aug 26 11:19:43.518135 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-Tenant-Name: tempest-TestShelveInstance-1187523687 Aug 26 11:19:43.518135 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User: tempest-TestShelveInstance-1187523687-project Aug 26 11:19:43.518135 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Id: default Aug 26 11:19:43.518135 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Domain-Name: Default Aug 26 11:19:43.518135 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Id: 93bec07110aa4697ab59ced454a51f9a Aug 26 11:19:43.518135 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: X-User-Name: tempest-TestShelveInstance-1187523687-project Aug 26 11:19:43.518135 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: method: > Aug 26 11:19:43.518135 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: exception: Instance 9ca2d22c-594f-47aa-9933-e2679fa45d7f could not be found. Aug 26 11:19:43.518135 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: action_args: {'id': '9ca2d22c-594f-47aa-9933-e2679fa45d7f'} Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: {{(pid=120605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ca2d22c-594f-47aa-9933-e2679fa45d7f could not be found. Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 11:19:43.519362 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ca2d22c-594f-47aa-9933-e2679fa45d7f could not be found. Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ca2d22c-594f-47aa-9933-e2679fa45d7f could not be found. Aug 26 11:19:43.521068 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: ERROR nova.api.openstack.wsgi Aug 26 11:19:43.522637 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: DEBUG nova.api.openstack.wsgi [None req-340175e7-277a-4488-8c76-e2736fe6b757 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Returning 404 to user: Instance 9ca2d22c-594f-47aa-9933-e2679fa45d7f could not be found. {{(pid=120605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 11:19:43.522637 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: INFO nova.api.openstack.requestlog [None req-340175e7-277a-4488-8c76-e2736fe6b757 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f" status: 404 len: 111 microversion: 2.1 time: 0.030667 Aug 26 11:19:43.522637 dv-cinder-852369-2-iscsi devstack@n-api.service[120605]: [pid: 120605|app: 0|req: 560/1096] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 11:19:43 2022] GET /compute/v2.1/servers/9ca2d22c-594f-47aa-9933-e2679fa45d7f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 11:19:43.680031 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-35247c7f-ed9a-4ac1-9692-f7b389861fc5 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] Calling method '.version_select at 0x7f1a68817700>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 11:19:43.699244 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-35247c7f-ed9a-4ac1-9692-f7b389861fc5 tempest-TestShelveInstance-1187523687 tempest-TestShelveInstance-1187523687-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-373540222" status: 202 len: 0 microversion: 2.1 time: 0.022990 Aug 26 11:19:43.700015 dv-cinder-852369-2-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 537/1097] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 11:19:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-373540222 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)